Skip to content

Faster str interning - #8459

Merged
AdamGS merged 1 commit into
developfrom
adamg/inline-str-interner
Jun 17, 2026
Merged

Faster str interning#8459
AdamGS merged 1 commit into
developfrom
adamg/inline-str-interner

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Summary

Makes two small changes to the string interner:

  1. Enables the inline-more feature of the lasso crate
  2. Use the faster hasher we try and use everywhere

@AdamGS
AdamGS requested review from a team and joseph-isaacs June 17, 2026 10:51
@AdamGS AdamGS added the changelog/performance A performance improvement label Jun 17, 2026
@AdamGS
AdamGS force-pushed the adamg/inline-str-interner branch from e106a35 to ccf319e Compare June 17, 2026 10:52
@AdamGS
AdamGS requested a review from robert3005 June 17, 2026 10:53
@AdamGS
Faster str interning
3ca882a 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/inline-str-interner branch from ccf319e to 3ca882a Compare June 17, 2026 10:53
@codspeed-hq

codspeed-hq Bot commented Jun 17, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
❌ 2 regressed benchmarks
✅ 1539 untouched benchmarks
⏩ 10 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation decompress_rd[f64, (100000, 0.0)] 845.4 µs 1,024 µs -17.45%
❌ Simulation decompress_rd[f32, (100000, 0.0)] 498.8 µs 586.5 µs -14.96%
⚡ Simulation decompress_rd[f64, (100000, 0.01)] 981.1 µs 845.4 µs +16.05%
⚡ Simulation decompress_rd[f64, (100000, 0.1)] 981 µs 845.4 µs +16.04%
⚡ Simulation bitwise_not_vortex_buffer_mut[128] 215.3 ns 186.1 ns +15.67%
⚡ Simulation bitwise_not_vortex_buffer_mut[1024] 275.6 ns 246.4 ns +11.84%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/inline-str-interner (3ca882a) with develop (170ff39)

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 17, 2026
@github-actions

github-actions Bot commented Jun 17, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 3ca882a 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 3ca882a 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.024x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.024x ➖, 0↑ 3↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 114561177 126043573 0.91
polarsignals_q01/datafusion:vortex-file-compressed 256147558 264806742 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22673385 23746145 0.95
polarsignals_q03/datafusion:vortex-file-compressed 276802756 260232195 1.06
polarsignals_q04/datafusion:vortex-file-compressed 🚨 10500074 9331249 1.13
polarsignals_q05/datafusion:vortex-file-compressed 🚨 15493696 14072557 1.10
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21904735 19780717 1.11
polarsignals_q07/datafusion:vortex-file-compressed 13786231 13057926 1.06
polarsignals_q08/datafusion:vortex-file-compressed 390693030 385156820 1.01
polarsignals_q09/datafusion:vortex-file-compressed 11589414 11954182 0.97

No file size changes detected.

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.2%
Engines: DataFusion No clear signal (-11.4%, environment too noisy confidence) · DuckDB No clear signal (-7.1%, environment too noisy confidence)
Vortex (geomean): 0.791x ✅
Parquet (geomean): 0.881x ✅
Shifts: Parquet (control) -11.9% · Median polish -18.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.761x ✅, 22↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 52428045 61712972 0.85
tpch_q02/datafusion:vortex-file-compressed 🚀 22172918 27558634 0.80
tpch_q03/datafusion:vortex-file-compressed 🚀 30433843 38835796 0.78
tpch_q04/datafusion:vortex-file-compressed 🚀 18847917 22140876 0.85
tpch_q05/datafusion:vortex-file-compressed 🚀 45898197 56932875 0.81
tpch_q06/datafusion:vortex-file-compressed 🚀 9975594 11813977 0.84
tpch_q07/datafusion:vortex-file-compressed 🚀 51091277 67434965 0.76
tpch_q08/datafusion:vortex-file-compressed 🚀 38701511 57866185 0.67
tpch_q09/datafusion:vortex-file-compressed 🚀 51961794 67295836 0.77
tpch_q10/datafusion:vortex-file-compressed 🚀 33300431 45876833 0.73
tpch_q11/datafusion:vortex-file-compressed 🚀 16554408 22998594 0.72
tpch_q12/datafusion:vortex-file-compressed 🚀 23281432 31815846 0.73
tpch_q13/datafusion:vortex-file-compressed 🚀 27144661 35150744 0.77
tpch_q14/datafusion:vortex-file-compressed 🚀 14918673 19770735 0.75
tpch_q15/datafusion:vortex-file-compressed 🚀 22042116 30783328 0.72
tpch_q16/datafusion:vortex-file-compressed 🚀 19645159 24202715 0.81
tpch_q17/datafusion:vortex-file-compressed 🚀 64477596 85300306 0.76
tpch_q18/datafusion:vortex-file-compressed 🚀 73232840 103473780 0.71
tpch_q19/datafusion:vortex-file-compressed 🚀 16887144 22092909 0.76
tpch_q20/datafusion:vortex-file-compressed 🚀 30144602 39530194 0.76
tpch_q21/datafusion:vortex-file-compressed 🚀 67002616 99249794 0.68
tpch_q22/datafusion:vortex-file-compressed 🚀 11893839 16128821 0.74
datafusion / vortex-compact (0.792x ✅, 22↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 58242740 75468501 0.77
tpch_q02/datafusion:vortex-compact 🚀 25908906 33188664 0.78
tpch_q03/datafusion:vortex-compact 🚀 33320189 42911954 0.78
tpch_q04/datafusion:vortex-compact 🚀 21748860 26890107 0.81
tpch_q05/datafusion:vortex-compact 🚀 46630323 60140055 0.78
tpch_q06/datafusion:vortex-compact 🚀 12075975 15859573 0.76
tpch_q07/datafusion:vortex-compact 🚀 54973671 68409930 0.80
tpch_q08/datafusion:vortex-compact 🚀 41810226 50844010 0.82
tpch_q09/datafusion:vortex-compact 🚀 54734029 73903802 0.74
tpch_q10/datafusion:vortex-compact 🚀 36153295 45555537 0.79
tpch_q11/datafusion:vortex-compact 🚀 17521278 22109522 0.79
tpch_q12/datafusion:vortex-compact 🚀 29239396 38951709 0.75
tpch_q13/datafusion:vortex-compact 🚀 32269313 40388043 0.80
tpch_q14/datafusion:vortex-compact 🚀 18460139 23452806 0.79
tpch_q15/datafusion:vortex-compact 🚀 29904941 36628411 0.82
tpch_q16/datafusion:vortex-compact 🚀 24840271 29107741 0.85
tpch_q17/datafusion:vortex-compact 🚀 68114704 83687647 0.81
tpch_q18/datafusion:vortex-compact 🚀 76036094 99701513 0.76
tpch_q19/datafusion:vortex-compact 🚀 40524311 46286288 0.88
tpch_q20/datafusion:vortex-compact 🚀 35416421 45354861 0.78
tpch_q21/datafusion:vortex-compact 🚀 74294567 93999194 0.79
tpch_q22/datafusion:vortex-compact 🚀 13268883 16933977 0.78
datafusion / parquet (0.875x ✅, 17↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 132017677 107624258 1.23
tpch_q02/datafusion:parquet 🚀 61294723 70688217 0.87
tpch_q03/datafusion:parquet 75174623 80074949 0.94
tpch_q04/datafusion:parquet 🚀 44390284 49568687 0.90
tpch_q05/datafusion:parquet 95228014 99056756 0.96
tpch_q06/datafusion:parquet 🚀 41059354 47132614 0.87
tpch_q07/datafusion:parquet 🚀 101364163 122112744 0.83
tpch_q08/datafusion:parquet 🚀 91726734 103750151 0.88
tpch_q09/datafusion:parquet 125799312 136083720 0.92
tpch_q10/datafusion:parquet 🚀 116526556 136915638 0.85
tpch_q11/datafusion:parquet 🚀 39720777 48334824 0.82
tpch_q12/datafusion:parquet 🚀 75674105 89024611 0.85
tpch_q13/datafusion:parquet 🚀 190615996 231858297 0.82
tpch_q14/datafusion:parquet 🚀 41912740 51015208 0.82
tpch_q15/datafusion:parquet 64902980 69539172 0.93
tpch_q16/datafusion:parquet 🚀 42119213 51341544 0.82
tpch_q17/datafusion:parquet 🚀 131844334 182711613 0.72
tpch_q18/datafusion:parquet 🚀 154642195 186276207 0.83
tpch_q19/datafusion:parquet 🚀 71654146 79919196 0.90
tpch_q20/datafusion:parquet 🚀 72007793 85157023 0.85
tpch_q21/datafusion:parquet 🚀 138733232 160130616 0.87
tpch_q22/datafusion:parquet 🚀 43399751 50413921 0.86
datafusion / arrow (0.774x ✅, 20↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 58318993 75097850 0.78
tpch_q02/datafusion:arrow 🚀 16881859 20224677 0.83
tpch_q03/datafusion:arrow 🚀 30982529 39848395 0.78
tpch_q04/datafusion:arrow 🚀 26313450 33945101 0.78
tpch_q05/datafusion:arrow 🚀 57003376 70738431 0.81
tpch_q06/datafusion:arrow 🚀 23678434 27313484 0.87
tpch_q07/datafusion:arrow 🚀 104716080 120685971 0.87
tpch_q08/datafusion:arrow 🚀 44661808 55029353 0.81
tpch_q09/datafusion:arrow 🚀 64705393 82298775 0.79
tpch_q10/datafusion:arrow 🚀 47068873 59507234 0.79
tpch_q11/datafusion:arrow 🚀 8905543 10454092 0.85
tpch_q12/datafusion:arrow 🚀 48836868 62557917 0.78
tpch_q13/datafusion:arrow 47164929 49064268 0.96
tpch_q14/datafusion:arrow 🚀 22287466 27508844 0.81
tpch_q15/datafusion:arrow 🚀 43769808 58648918 0.75
tpch_q16/datafusion:arrow 16697605 18475728 0.90
tpch_q17/datafusion:arrow 🚀 66547356 78797828 0.84
tpch_q18/datafusion:arrow 🚀 105821286 163752700 0.65
tpch_q19/datafusion:arrow 🚀 36606834 66975082 0.55
tpch_q20/datafusion:arrow 🚀 35677782 69949652 0.51
tpch_q21/datafusion:arrow 🚀 154465957 229662742 0.67
tpch_q22/datafusion:arrow 🚀 11665855 13915085 0.84
duckdb / vortex-file-compressed (0.816x ✅, 21↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31148482 34296839 0.91
tpch_q02/duckdb:vortex-file-compressed 🚀 25269039 29262453 0.86
tpch_q03/duckdb:vortex-file-compressed 🚀 33550711 37803554 0.89
tpch_q04/duckdb:vortex-file-compressed 🚀 28615295 34348701 0.83
tpch_q05/duckdb:vortex-file-compressed 🚀 37594325 46211735 0.81
tpch_q06/duckdb:vortex-file-compressed 🚀 8415041 10555773 0.80
tpch_q07/duckdb:vortex-file-compressed 🚀 35393326 43347789 0.82
tpch_q08/duckdb:vortex-file-compressed 🚀 37426573 42506309 0.88
tpch_q09/duckdb:vortex-file-compressed 🚀 59595533 72311847 0.82
tpch_q10/duckdb:vortex-file-compressed 🚀 41851937 53923697 0.78
tpch_q11/duckdb:vortex-file-compressed 🚀 15145917 17279101 0.88
tpch_q12/duckdb:vortex-file-compressed 🚀 22945649 30680384 0.75
tpch_q13/duckdb:vortex-file-compressed 🚀 41354430 49200487 0.84
tpch_q14/duckdb:vortex-file-compressed 🚀 21841391 25139545 0.87
tpch_q15/duckdb:vortex-file-compressed 🚀 16848823 20417669 0.83
tpch_q16/duckdb:vortex-file-compressed 🚀 29272772 35753278 0.82
tpch_q17/duckdb:vortex-file-compressed 🚀 24546761 29660032 0.83
tpch_q18/duckdb:vortex-file-compressed 🚀 53506130 61905343 0.86
tpch_q19/duckdb:vortex-file-compressed 🚀 28993323 36909127 0.79
tpch_q20/duckdb:vortex-file-compressed 🚀 33833385 39524432 0.86
tpch_q21/duckdb:vortex-file-compressed 🚀 100201920 169522515 0.59
tpch_q22/duckdb:vortex-file-compressed 🚀 17190513 24190917 0.71
duckdb / vortex-compact (0.796x ✅, 21↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 38861948 45382612 0.86
tpch_q02/duckdb:vortex-compact 🚀 32917988 41871839 0.79
tpch_q03/duckdb:vortex-compact 🚀 34159309 45975464 0.74
tpch_q04/duckdb:vortex-compact 🚀 30663828 39906073 0.77
tpch_q05/duckdb:vortex-compact 🚀 40534586 50850773 0.80
tpch_q06/duckdb:vortex-compact 🚀 10904232 14544874 0.75
tpch_q07/duckdb:vortex-compact 🚀 40922171 58294217 0.70
tpch_q08/duckdb:vortex-compact 🚀 42844346 56913589 0.75
tpch_q09/duckdb:vortex-compact 🚀 64991969 76756776 0.85
tpch_q10/duckdb:vortex-compact 🚀 45188867 53735189 0.84
tpch_q11/duckdb:vortex-compact 🚀 17893670 20946802 0.85
tpch_q12/duckdb:vortex-compact 🚀 29704518 39069491 0.76
tpch_q13/duckdb:vortex-compact 🚀 47479226 62689132 0.76
tpch_q14/duckdb:vortex-compact 🚀 25836174 37259978 0.69
tpch_q15/duckdb:vortex-compact 🚀 19820794 24138108 0.82
tpch_q16/duckdb:vortex-compact 33164927 36190162 0.92
tpch_q17/duckdb:vortex-compact 🚀 29432021 34202004 0.86
tpch_q18/duckdb:vortex-compact 🚀 53750031 63022677 0.85
tpch_q19/duckdb:vortex-compact 🚀 33294610 44385674 0.75
tpch_q20/duckdb:vortex-compact 🚀 39271655 50668266 0.78
tpch_q21/duckdb:vortex-compact 🚀 102054109 126184566 0.81
tpch_q22/duckdb:vortex-compact 🚀 18480490 21173538 0.87
duckdb / parquet (0.887x ✅, 12↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78022071 79511791 0.98
tpch_q02/duckdb:parquet 🚀 38941445 43857668 0.89
tpch_q03/duckdb:parquet 70070849 76391455 0.92
tpch_q04/duckdb:parquet 🚀 49163279 59489796 0.83
tpch_q05/duckdb:parquet 70814067 74681692 0.95
tpch_q06/duckdb:parquet 22482089 23956161 0.94
tpch_q07/duckdb:parquet 80237105 78402807 1.02
tpch_q08/duckdb:parquet 🚀 85522913 97108942 0.88
tpch_q09/duckdb:parquet 🚀 133594554 171641759 0.78
tpch_q10/duckdb:parquet 🚀 126363045 149338076 0.85
tpch_q11/duckdb:parquet 🚀 22325391 26019279 0.86
tpch_q12/duckdb:parquet 46540218 51334820 0.91
tpch_q13/duckdb:parquet 🚀 254608828 312447959 0.81
tpch_q14/duckdb:parquet 🚀 50608008 56322601 0.90
tpch_q15/duckdb:parquet 🚀 26306630 32858041 0.80
tpch_q16/duckdb:parquet 🚀 57890453 66368795 0.87
tpch_q17/duckdb:parquet 59024499 60741444 0.97
tpch_q18/duckdb:parquet 121027433 132773074 0.91
tpch_q19/duckdb:parquet 🚀 68363562 83766840 0.82
tpch_q20/duckdb:parquet 65484904 70209239 0.93
tpch_q21/duckdb:parquet 🚀 174694304 209243742 0.83
tpch_q22/duckdb:parquet 53638445 58149502 0.92
duckdb / duckdb (0.863x ✅, 20↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17566957 19118555 0.92
tpch_q02/duckdb:duckdb 🚀 14059462 16415620 0.86
tpch_q03/duckdb:duckdb 🚀 22135070 26047936 0.85
tpch_q04/duckdb:duckdb 🚀 21977184 24777653 0.89
tpch_q05/duckdb:duckdb 🚀 22749544 25342878 0.90
tpch_q06/duckdb:duckdb 6984357 7671770 0.91
tpch_q07/duckdb:duckdb 🚀 25281823 29506404 0.86
tpch_q08/duckdb:duckdb 🚀 23858161 27804848 0.86
tpch_q09/duckdb:duckdb 🚀 57694483 71531043 0.81
tpch_q10/duckdb:duckdb 🚀 50303586 58438418 0.86
tpch_q11/duckdb:duckdb 🚀 7069246 8543015 0.83
tpch_q12/duckdb:duckdb 🚀 17764146 19771375 0.90
tpch_q13/duckdb:duckdb 🚀 39820719 47460537 0.84
tpch_q14/duckdb:duckdb 🚀 21287416 24984539 0.85
tpch_q15/duckdb:duckdb 🚀 13690372 15352592 0.89
tpch_q16/duckdb:duckdb 🚀 26065080 30383977 0.86
tpch_q17/duckdb:duckdb 🚀 15897380 18080665 0.88
tpch_q18/duckdb:duckdb 🚀 40532818 45436790 0.89
tpch_q19/duckdb:duckdb 🚀 30686303 36706230 0.84
tpch_q20/duckdb:duckdb 🚀 25054474 31267378 0.80
tpch_q21/duckdb:duckdb 🚀 61564702 72293490 0.85
tpch_q22/duckdb:duckdb 🚀 25344825 29229565 0.87
File Size Changes (9 files changed, +0.1% overall, 5↑ 4↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 1.0 vortex-compact 20.78 MB 20.93 MB +152.98 KB +0.7%
orders_0.vortex 1.0 vortex-file-compressed 35.24 MB 35.34 MB +105.58 KB +0.3%
lineitem_0.vortex 1.0 vortex-file-compressed 82.10 MB 82.24 MB +143.12 KB +0.2%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.70 MB +13.64 KB +0.1%
lineitem_1.vortex 1.0 vortex-file-compressed 82.00 MB 82.02 MB +20.13 KB +0.0%
part_0.vortex 1.0 vortex-file-compressed 4.81 MB 4.81 MB 4.21 KB -0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.77 MB 8.76 MB 14.71 KB -0.2%
supplier_0.vortex 1.0 vortex-file-compressed 601.86 KB 592.11 KB 9.75 KB -1.6%
part_0.vortex 1.0 vortex-compact 3.39 MB 3.32 MB 77.58 KB -2.2%

Totals:

  • vortex-compact: 190.60 MB → 190.67 MB (+0.0%)
  • vortex-file-compressed: 237.47 MB → 237.72 MB (+0.1%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): 1.105x ❌
Parquet (geomean): 1.122x ❌
Shifts: Parquet (control) +12.2% · Median polish +11.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.126x ❌, 0↑ 7↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5964244 5681146 1.05
fineweb_q01/datafusion:vortex-file-compressed 🚨 40404791 33172109 1.22
fineweb_q02/datafusion:vortex-file-compressed 🚨 44002900 39360407 1.12
fineweb_q03/datafusion:vortex-file-compressed 🚨 65772397 58589478 1.12
fineweb_q04/datafusion:vortex-file-compressed 🚨 318221765 278051757 1.14
fineweb_q05/datafusion:vortex-file-compressed 🚨 253674893 221983365 1.14
fineweb_q06/datafusion:vortex-file-compressed 🚨 55827043 49187386 1.13
fineweb_q07/datafusion:vortex-file-compressed 🚨 63246425 54656030 1.16
fineweb_q08/datafusion:vortex-file-compressed 24971923 23741600 1.05
datafusion / vortex-compact (1.103x ❌, 0↑ 5↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6258374 5716381 1.09
fineweb_q01/datafusion:vortex-compact 108773223 108406211 1.00
fineweb_q02/datafusion:vortex-compact 114239093 105054367 1.09
fineweb_q03/datafusion:vortex-compact 🚨 997718788 873544786 1.14
fineweb_q04/datafusion:vortex-compact 🚨 1042530315 920887825 1.13
fineweb_q05/datafusion:vortex-compact 🚨 940666487 828546031 1.14
fineweb_q06/datafusion:vortex-compact 🚨 530647736 465233082 1.14
fineweb_q07/datafusion:vortex-compact 🚨 540374199 487726413 1.11
fineweb_q08/datafusion:vortex-compact 24113215 22170504 1.09
datafusion / parquet (1.135x ❌, 0↑ 7↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7858300 6452369 1.22
fineweb_q01/datafusion:parquet 326419479 298826338 1.09
fineweb_q02/datafusion:parquet 🚨 335197213 293703934 1.14
fineweb_q03/datafusion:parquet 🚨 332329135 286262807 1.16
fineweb_q04/datafusion:parquet 🚨 343219018 305736385 1.12
fineweb_q05/datafusion:parquet 🚨 342231913 306202382 1.12
fineweb_q06/datafusion:parquet 325986544 306750626 1.06
fineweb_q07/datafusion:parquet 🚨 327780520 282657818 1.16
fineweb_q08/datafusion:parquet 🚨 322349042 280761920 1.15
duckdb / vortex-file-compressed (1.132x ❌, 0↑ 6↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4066091 3395992 1.20
fineweb_q01/duckdb:vortex-file-compressed 35789521 33106370 1.08
fineweb_q02/duckdb:vortex-file-compressed 🚨 45717607 40841007 1.12
fineweb_q03/duckdb:vortex-file-compressed 🚨 142347534 113411708 1.26
fineweb_q04/duckdb:vortex-file-compressed 🚨 302101042 271138309 1.11
fineweb_q05/duckdb:vortex-file-compressed 235773793 215725542 1.09
fineweb_q06/duckdb:vortex-file-compressed 🚨 57825829 51603277 1.12
fineweb_q07/duckdb:vortex-file-compressed 🚨 60155593 53176946 1.13
fineweb_q08/duckdb:vortex-file-compressed 24527210 22532470 1.09
duckdb / vortex-compact (1.061x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4680953 4134676 1.13
fineweb_q01/duckdb:vortex-compact 110721307 102936851 1.08
fineweb_q02/duckdb:vortex-compact 114939753 117014545 0.98
fineweb_q03/duckdb:vortex-compact 931449549 865155803 1.08
fineweb_q04/duckdb:vortex-compact 944977752 895739652 1.05
fineweb_q05/duckdb:vortex-compact 853343396 801081573 1.07
fineweb_q06/duckdb:vortex-compact 483490427 464009381 1.04
fineweb_q07/duckdb:vortex-compact 502861142 479529725 1.05
fineweb_q08/duckdb:vortex-compact 21412774 19819765 1.08
duckdb / parquet (1.109x ❌, 0↑ 4↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35127698 31954071 1.10
fineweb_q01/duckdb:parquet 🚨 96787556 83971379 1.15
fineweb_q02/duckdb:parquet 🚨 96464650 84854589 1.14
fineweb_q03/duckdb:parquet 🚨 353021318 317833681 1.11
fineweb_q04/duckdb:parquet 488156602 448313099 1.09
fineweb_q05/duckdb:parquet 450888526 413718970 1.09
fineweb_q06/duckdb:parquet 222610403 204337800 1.09
fineweb_q07/duckdb:parquet 236277112 216278955 1.09
fineweb_q08/duckdb:parquet 🚨 36915117 32809233 1.13
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +209.39 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-0.0%, environment too noisy confidence) · DuckDB No clear signal (+1.7%, low confidence)
Vortex (geomean): 1.055x ➖
Parquet (geomean): 1.047x ➖
Shifts: Parquet (control) +4.7% · Median polish +4.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.062x ➖, 2↑ 17↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27952992 27731864 1.01
tpcds_q02/datafusion:vortex-file-compressed 48828507 48266609 1.01
tpcds_q03/datafusion:vortex-file-compressed 16176448 15099985 1.07
tpcds_q04/datafusion:vortex-file-compressed 270601934 263742232 1.03
tpcds_q05/datafusion:vortex-file-compressed 45363639 44087795 1.03
tpcds_q06/datafusion:vortex-file-compressed 23629741 23331750 1.01
tpcds_q07/datafusion:vortex-file-compressed 43000945 39484856 1.09
tpcds_q08/datafusion:vortex-file-compressed 🚨 33494985 29260754 1.14
tpcds_q09/datafusion:vortex-file-compressed 🚨 33424579 29745286 1.12
tpcds_q10/datafusion:vortex-file-compressed 40882401 38485293 1.06
tpcds_q11/datafusion:vortex-file-compressed 137567521 130350168 1.06
tpcds_q12/datafusion:vortex-file-compressed 🚨 21575975 18598389 1.16
tpcds_q13/datafusion:vortex-file-compressed 48411491 45189946 1.07
tpcds_q14/datafusion:vortex-file-compressed 174290494 168127731 1.04
tpcds_q15/datafusion:vortex-file-compressed 🚨 28440043 25660893 1.11
tpcds_q16/datafusion:vortex-file-compressed 26388336 24555616 1.07
tpcds_q17/datafusion:vortex-file-compressed 66667484 64157604 1.04
tpcds_q18/datafusion:vortex-file-compressed 68169834 63056091 1.08
tpcds_q19/datafusion:vortex-file-compressed 23115925 21698187 1.07
tpcds_q20/datafusion:vortex-file-compressed 🚨 22543136 20408300 1.10
tpcds_q21/datafusion:vortex-file-compressed 38148180 36472421 1.05
tpcds_q22/datafusion:vortex-file-compressed 🚀 137404689 154738032 0.89
tpcds_q23/datafusion:vortex-file-compressed 165662593 154973707 1.07
tpcds_q24/datafusion:vortex-file-compressed 90740509 83706362 1.08
tpcds_q25/datafusion:vortex-file-compressed 67273992 64706046 1.04
tpcds_q26/datafusion:vortex-file-compressed 🚨 37849385 32765610 1.16
tpcds_q27/datafusion:vortex-file-compressed 98463928 89859873 1.10
tpcds_q28/datafusion:vortex-file-compressed 30595889 29366167 1.04
tpcds_q29/datafusion:vortex-file-compressed 65007249 60723809 1.07
tpcds_q30/datafusion:vortex-file-compressed 24663615 23339183 1.06
tpcds_q31/datafusion:vortex-file-compressed 79385877 73665005 1.08
tpcds_q32/datafusion:vortex-file-compressed 🚨 20715794 18730759 1.11
tpcds_q33/datafusion:vortex-file-compressed 30521270 29346101 1.04
tpcds_q34/datafusion:vortex-file-compressed 28531436 26055105 1.10
tpcds_q35/datafusion:vortex-file-compressed 🚨 48980711 44499224 1.10
tpcds_q36/datafusion:vortex-file-compressed 61129813 59689642 1.02
tpcds_q37/datafusion:vortex-file-compressed 🚨 22121154 19494962 1.13
tpcds_q38/datafusion:vortex-file-compressed 🚨 49206708 43700683 1.13
tpcds_q39/datafusion:vortex-file-compressed 117385832 106817590 1.10
tpcds_q40/datafusion:vortex-file-compressed 32470099 32214572 1.01
tpcds_q41/datafusion:vortex-file-compressed 16813782 15425400 1.09
tpcds_q42/datafusion:vortex-file-compressed 14506116 14261285 1.02
tpcds_q43/datafusion:vortex-file-compressed 19194417 19201391 1.00
tpcds_q44/datafusion:vortex-file-compressed 31291149 29056285 1.08
tpcds_q45/datafusion:vortex-file-compressed 28048784 27738970 1.01
tpcds_q46/datafusion:vortex-file-compressed 36970154 35035590 1.06
tpcds_q47/datafusion:vortex-file-compressed 141965437 132671783 1.07
tpcds_q48/datafusion:vortex-file-compressed 34845808 33087469 1.05
tpcds_q49/datafusion:vortex-file-compressed 61047084 56590111 1.08
tpcds_q50/datafusion:vortex-file-compressed 🚨 43549806 39251427 1.11
tpcds_q51/datafusion:vortex-file-compressed 99181889 93767570 1.06
tpcds_q52/datafusion:vortex-file-compressed 15049735 14225205 1.06
tpcds_q53/datafusion:vortex-file-compressed 24167349 22373093 1.08
tpcds_q54/datafusion:vortex-file-compressed 35875886 33490936 1.07
tpcds_q55/datafusion:vortex-file-compressed 15403867 14084044 1.09
tpcds_q56/datafusion:vortex-file-compressed 31305638 30255011 1.03
tpcds_q57/datafusion:vortex-file-compressed 110431211 108626366 1.02
tpcds_q58/datafusion:vortex-file-compressed 59816303 57147315 1.05
tpcds_q59/datafusion:vortex-file-compressed 60093678 58562001 1.03
tpcds_q60/datafusion:vortex-file-compressed 30399568 30044342 1.01
tpcds_q61/datafusion:vortex-file-compressed 41357035 39476443 1.05
tpcds_q62/datafusion:vortex-file-compressed 🚀 23755907 26543768 0.89
tpcds_q63/datafusion:vortex-file-compressed 23651854 21743546 1.09
tpcds_q64/datafusion:vortex-file-compressed 410115124 379070394 1.08
tpcds_q65/datafusion:vortex-file-compressed 53803520 52280577 1.03
tpcds_q66/datafusion:vortex-file-compressed 74984727 73501316 1.02
tpcds_q67/datafusion:vortex-file-compressed 158980299 154582693 1.03
tpcds_q68/datafusion:vortex-file-compressed 34917205 34268721 1.02
tpcds_q69/datafusion:vortex-file-compressed 38866736 36234751 1.07
tpcds_q70/datafusion:vortex-file-compressed 100200742 95337107 1.05
tpcds_q71/datafusion:vortex-file-compressed 23931487 23628448 1.01
tpcds_q72/datafusion:vortex-file-compressed 2244257314 2117161443 1.06
tpcds_q73/datafusion:vortex-file-compressed 26170272 24343899 1.08
tpcds_q74/datafusion:vortex-file-compressed 86682939 82393026 1.05
tpcds_q75/datafusion:vortex-file-compressed 115585024 111949840 1.03
tpcds_q76/datafusion:vortex-file-compressed 34150996 31496576 1.08
tpcds_q77/datafusion:vortex-file-compressed 41650842 39381538 1.06
tpcds_q78/datafusion:vortex-file-compressed 127210803 116191208 1.09
tpcds_q79/datafusion:vortex-file-compressed 30863674 29901201 1.03
tpcds_q80/datafusion:vortex-file-compressed 93979550 90085811 1.04
tpcds_q81/datafusion:vortex-file-compressed 26356010 25394082 1.04
tpcds_q82/datafusion:vortex-file-compressed 22517142 22126292 1.02
tpcds_q83/datafusion:vortex-file-compressed 38313391 35282853 1.09
tpcds_q84/datafusion:vortex-file-compressed 🚨 14398311 12685082 1.14
tpcds_q85/datafusion:vortex-file-compressed 92499376 87201705 1.06
tpcds_q86/datafusion:vortex-file-compressed 16719893 16077446 1.04
tpcds_q87/datafusion:vortex-file-compressed 46984529 42876597 1.10
tpcds_q88/datafusion:vortex-file-compressed 59836005 56524395 1.06
tpcds_q89/datafusion:vortex-file-compressed 25932130 25760572 1.01
tpcds_q90/datafusion:vortex-file-compressed 15220090 14587151 1.04
tpcds_q91/datafusion:vortex-file-compressed 🚨 19915962 17699895 1.13
tpcds_q92/datafusion:vortex-file-compressed 🚨 18193070 16358327 1.11
tpcds_q93/datafusion:vortex-file-compressed 🚨 35799018 32022947 1.12
tpcds_q94/datafusion:vortex-file-compressed 🚨 24439303 21344859 1.14
tpcds_q95/datafusion:vortex-file-compressed 64644492 59892943 1.08
tpcds_q96/datafusion:vortex-file-compressed 14632109 13752032 1.06
tpcds_q97/datafusion:vortex-file-compressed 32249469 30314347 1.06
tpcds_q98/datafusion:vortex-file-compressed 25168866 22995031 1.09
tpcds_q99/datafusion:vortex-file-compressed 🚨 33347678 27896679 1.20
datafusion / vortex-compact (1.054x ➖, 0↑ 11↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 28128547 24982100 1.13
tpcds_q02/datafusion:vortex-compact 55831777 53684167 1.04
tpcds_q03/datafusion:vortex-compact 20400160 19536689 1.04
tpcds_q04/datafusion:vortex-compact 316708259 303666204 1.04
tpcds_q05/datafusion:vortex-compact 49844239 47534072 1.05
tpcds_q06/datafusion:vortex-compact 28203439 26695746 1.06
tpcds_q07/datafusion:vortex-compact 54497190 54958093 0.99
tpcds_q08/datafusion:vortex-compact 37722473 36055374 1.05
tpcds_q09/datafusion:vortex-compact 43733892 41896233 1.04
tpcds_q10/datafusion:vortex-compact 50508751 48647961 1.04
tpcds_q11/datafusion:vortex-compact 🚨 169033347 147888192 1.14
tpcds_q12/datafusion:vortex-compact 24973920 23685949 1.05
tpcds_q13/datafusion:vortex-compact 129937329 128600386 1.01
tpcds_q14/datafusion:vortex-compact 195320142 188390382 1.04
tpcds_q15/datafusion:vortex-compact 30235669 27929681 1.08
tpcds_q16/datafusion:vortex-compact 30352764 28112196 1.08
tpcds_q17/datafusion:vortex-compact 77002986 71525064 1.08
tpcds_q18/datafusion:vortex-compact 78511265 73392572 1.07
tpcds_q19/datafusion:vortex-compact 🚨 33758503 29509465 1.14
tpcds_q20/datafusion:vortex-compact 27225040 25480359 1.07
tpcds_q21/datafusion:vortex-compact 41062379 42097265 0.98
tpcds_q22/datafusion:vortex-compact 🚨 164238684 128745231 1.28
tpcds_q23/datafusion:vortex-compact 174166276 163598829 1.06
tpcds_q24/datafusion:vortex-compact 100862115 97610593 1.03
tpcds_q25/datafusion:vortex-compact 82817966 78521252 1.05
tpcds_q26/datafusion:vortex-compact 47316496 45474689 1.04
tpcds_q27/datafusion:vortex-compact 126494613 116310210 1.09
tpcds_q28/datafusion:vortex-compact 98924196 94360915 1.05
tpcds_q29/datafusion:vortex-compact 76439064 74702963 1.02
tpcds_q30/datafusion:vortex-compact 30718555 29022285 1.06
tpcds_q31/datafusion:vortex-compact 103309778 98573584 1.05
tpcds_q32/datafusion:vortex-compact 25940572 23752703 1.09
tpcds_q33/datafusion:vortex-compact 37818302 38180916 0.99
tpcds_q34/datafusion:vortex-compact 35651507 35035813 1.02
tpcds_q35/datafusion:vortex-compact 53789225 51612980 1.04
tpcds_q36/datafusion:vortex-compact 80233199 75514017 1.06
tpcds_q37/datafusion:vortex-compact 31654199 30102473 1.05
tpcds_q38/datafusion:vortex-compact 54927707 50366929 1.09
tpcds_q39/datafusion:vortex-compact 124490961 113197709 1.10
tpcds_q40/datafusion:vortex-compact 37296090 34014077 1.10
tpcds_q41/datafusion:vortex-compact 19354946 17644483 1.10
tpcds_q42/datafusion:vortex-compact 19028262 18122302 1.05
tpcds_q43/datafusion:vortex-compact 25561993 24742020 1.03
tpcds_q44/datafusion:vortex-compact 41842122 40480559 1.03
tpcds_q45/datafusion:vortex-compact 🚨 34936037 30508415 1.15
tpcds_q46/datafusion:vortex-compact 47203475 46764426 1.01
tpcds_q47/datafusion:vortex-compact 169685083 156203299 1.09
tpcds_q48/datafusion:vortex-compact 82012949 81849304 1.00
tpcds_q49/datafusion:vortex-compact 70593973 68741807 1.03
tpcds_q50/datafusion:vortex-compact 48057261 45919304 1.05
tpcds_q51/datafusion:vortex-compact 99822261 99077709 1.01
tpcds_q52/datafusion:vortex-compact 19672571 18537869 1.06
tpcds_q53/datafusion:vortex-compact 29409048 28505579 1.03
tpcds_q54/datafusion:vortex-compact 🚨 44976026 40611509 1.11
tpcds_q55/datafusion:vortex-compact 18891873 17539086 1.08
tpcds_q56/datafusion:vortex-compact 38220680 35895692 1.06
tpcds_q57/datafusion:vortex-compact 122064479 118417198 1.03
tpcds_q58/datafusion:vortex-compact 66078812 67552002 0.98
tpcds_q59/datafusion:vortex-compact 72194788 70546856 1.02
tpcds_q60/datafusion:vortex-compact 37193081 35332952 1.05
tpcds_q61/datafusion:vortex-compact 56290766 54392866 1.03
tpcds_q62/datafusion:vortex-compact 🚨 26511517 23724326 1.12
tpcds_q63/datafusion:vortex-compact 29636951 29695367 1.00
tpcds_q64/datafusion:vortex-compact 451386713 418479126 1.08
tpcds_q65/datafusion:vortex-compact 67395526 64447980 1.05
tpcds_q66/datafusion:vortex-compact 80409397 75875664 1.06
tpcds_q67/datafusion:vortex-compact 166860159 155916836 1.07
tpcds_q68/datafusion:vortex-compact 45558305 46467749 0.98
tpcds_q69/datafusion:vortex-compact 48735761 47761214 1.02
tpcds_q70/datafusion:vortex-compact 111740152 108018748 1.03
tpcds_q71/datafusion:vortex-compact 30568821 29974213 1.02
tpcds_q72/datafusion:vortex-compact 2270248342 2079684724 1.09
tpcds_q73/datafusion:vortex-compact 32293387 31087641 1.04
tpcds_q74/datafusion:vortex-compact 100381411 99404914 1.01
tpcds_q75/datafusion:vortex-compact 139862694 131459958 1.06
tpcds_q76/datafusion:vortex-compact 34989078 33341612 1.05
tpcds_q77/datafusion:vortex-compact 51311563 47925770 1.07
tpcds_q78/datafusion:vortex-compact 137134876 130963957 1.05
tpcds_q79/datafusion:vortex-compact 40218336 39643228 1.01
tpcds_q80/datafusion:vortex-compact 107836167 101596466 1.06
tpcds_q81/datafusion:vortex-compact 🚨 30918658 28097850 1.10
tpcds_q82/datafusion:vortex-compact 33023607 33666999 0.98
tpcds_q83/datafusion:vortex-compact 37512870 36167540 1.04
tpcds_q84/datafusion:vortex-compact 15435912 14778058 1.04
tpcds_q85/datafusion:vortex-compact 160856299 153391140 1.05
tpcds_q86/datafusion:vortex-compact 🚨 22175659 19198342 1.16
tpcds_q87/datafusion:vortex-compact 52760311 51238820 1.03
tpcds_q88/datafusion:vortex-compact 77322293 75069424 1.03
tpcds_q89/datafusion:vortex-compact 31990180 30931158 1.03
tpcds_q90/datafusion:vortex-compact 15448574 14509722 1.06
tpcds_q91/datafusion:vortex-compact 33998842 32107042 1.06
tpcds_q92/datafusion:vortex-compact 🚨 27652829 22978383 1.20
tpcds_q93/datafusion:vortex-compact 38112804 36028589 1.06
tpcds_q94/datafusion:vortex-compact 27259213 27089338 1.01
tpcds_q95/datafusion:vortex-compact 62979319 63218194 1.00
tpcds_q96/datafusion:vortex-compact 17328338 16871076 1.03
tpcds_q97/datafusion:vortex-compact 35530085 34402628 1.03
tpcds_q98/datafusion:vortex-compact 30624733 31142354 0.98
tpcds_q99/datafusion:vortex-compact 🚨 35287606 29774763 1.19
datafusion / parquet (1.058x ➖, 1↑ 19↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 24828680 23769515 1.04
tpcds_q02/datafusion:parquet 43527175 41947004 1.04
tpcds_q03/datafusion:parquet 14190126 13343320 1.06
tpcds_q04/datafusion:parquet 316331975 324269274 0.98
tpcds_q05/datafusion:parquet 49892459 46147697 1.08
tpcds_q06/datafusion:parquet 25778624 23773158 1.08
tpcds_q07/datafusion:parquet 81830699 77814655 1.05
tpcds_q08/datafusion:parquet 31229112 28875363 1.08
tpcds_q09/datafusion:parquet 42059528 38845468 1.08
tpcds_q10/datafusion:parquet 76897466 72112107 1.07
tpcds_q11/datafusion:parquet 🚨 166368516 143749528 1.16
tpcds_q12/datafusion:parquet 🚨 19871582 17886851 1.11
tpcds_q13/datafusion:parquet 79953600 75475136 1.06
tpcds_q14/datafusion:parquet 163633875 164995766 0.99
tpcds_q15/datafusion:parquet 21571716 21642695 1.00
tpcds_q16/datafusion:parquet 29594500 31045582 0.95
tpcds_q17/datafusion:parquet 63729866 63873753 1.00
tpcds_q18/datafusion:parquet 110986388 107984722 1.03
tpcds_q19/datafusion:parquet 24445463 23068905 1.06
tpcds_q20/datafusion:parquet 🚨 19683318 16974192 1.16
tpcds_q21/datafusion:parquet 🚨 20433189 18249486 1.12
tpcds_q22/datafusion:parquet 170416506 165489511 1.03
tpcds_q23/datafusion:parquet 🚨 163259341 147282960 1.11
tpcds_q24/datafusion:parquet 93849473 90843842 1.03
tpcds_q25/datafusion:parquet 66000145 61488287 1.07
tpcds_q26/datafusion:parquet 70355457 64536209 1.09
tpcds_q27/datafusion:parquet 149051874 136988556 1.09
tpcds_q28/datafusion:parquet 47819754 45711649 1.05
tpcds_q29/datafusion:parquet 68074418 64164332 1.06
tpcds_q30/datafusion:parquet 🚨 37733076 34068877 1.11
tpcds_q31/datafusion:parquet 71000447 65187918 1.09
tpcds_q32/datafusion:parquet 🚨 18799724 16087401 1.17
tpcds_q33/datafusion:parquet 28497944 27870620 1.02
tpcds_q34/datafusion:parquet 23133346 24046851 0.96
tpcds_q35/datafusion:parquet 🚨 79655826 71672899 1.11
tpcds_q36/datafusion:parquet 61062802 58822558 1.04
tpcds_q37/datafusion:parquet 20769466 19129613 1.09
tpcds_q38/datafusion:parquet 43475970 40266302 1.08
tpcds_q39/datafusion:parquet 81143015 75591145 1.07
tpcds_q40/datafusion:parquet 23362790 23352308 1.00
tpcds_q41/datafusion:parquet 🚨 16377051 14853246 1.10
tpcds_q42/datafusion:parquet 12492565 11960985 1.04
tpcds_q43/datafusion:parquet 18748107 17370307 1.08
tpcds_q44/datafusion:parquet 34222243 33558375 1.02
tpcds_q45/datafusion:parquet 🚨 30534202 26892240 1.14
tpcds_q46/datafusion:parquet 33682488 32459537 1.04
tpcds_q47/datafusion:parquet 140435852 130214429 1.08
tpcds_q48/datafusion:parquet 73355282 70660358 1.04
tpcds_q49/datafusion:parquet 59156693 55676917 1.06
tpcds_q50/datafusion:parquet 44235512 42766949 1.03
tpcds_q51/datafusion:parquet 92131209 88180337 1.04
tpcds_q52/datafusion:parquet 12544236 12270620 1.02
tpcds_q53/datafusion:parquet 🚨 19481583 17691244 1.10
tpcds_q54/datafusion:parquet 35663241 32701710 1.09
tpcds_q55/datafusion:parquet 11852802 11845450 1.00
tpcds_q56/datafusion:parquet 29519848 28314234 1.04
tpcds_q57/datafusion:parquet 99703602 94640010 1.05
tpcds_q58/datafusion:parquet 60068718 55419507 1.08
tpcds_q59/datafusion:parquet 66771007 61624793 1.08
tpcds_q60/datafusion:parquet 29309215 28646388 1.02
tpcds_q61/datafusion:parquet 45402271 44163387 1.03
tpcds_q62/datafusion:parquet 🚀 20758679 25134191 0.83
tpcds_q63/datafusion:parquet 18375458 19066282 0.96
tpcds_q64/datafusion:parquet 321361138 298257157 1.08
tpcds_q65/datafusion:parquet 38831577 38660603 1.00
tpcds_q66/datafusion:parquet 🚨 74101808 66795674 1.11
tpcds_q67/datafusion:parquet 163604210 149314900 1.10
tpcds_q68/datafusion:parquet 34735507 31821676 1.09
tpcds_q69/datafusion:parquet 72368780 71320535 1.01
tpcds_q70/datafusion:parquet 34926653 32548962 1.07
tpcds_q71/datafusion:parquet 25385312 23588983 1.08
tpcds_q72/datafusion:parquet 633971379 589232849 1.08
tpcds_q73/datafusion:parquet 22242936 20650009 1.08
tpcds_q74/datafusion:parquet 🚨 90287310 81466266 1.11
tpcds_q75/datafusion:parquet 🚨 112303605 101751311 1.10
tpcds_q76/datafusion:parquet 31322721 30206769 1.04
tpcds_q77/datafusion:parquet 41472008 41284116 1.00
tpcds_q78/datafusion:parquet 116714079 107988648 1.08
tpcds_q79/datafusion:parquet 28366353 26405527 1.07
tpcds_q80/datafusion:parquet 80182104 75894256 1.06
tpcds_q81/datafusion:parquet 30547757 29462174 1.04
tpcds_q82/datafusion:parquet 🚨 20793580 18709998 1.11
tpcds_q83/datafusion:parquet 43807261 41517304 1.06
tpcds_q84/datafusion:parquet 43375671 39783445 1.09
tpcds_q85/datafusion:parquet 151508093 147852636 1.02
tpcds_q86/datafusion:parquet 🚨 17148462 14302949 1.20
tpcds_q87/datafusion:parquet 45769127 44138177 1.04
tpcds_q88/datafusion:parquet 61298312 59747762 1.03
tpcds_q89/datafusion:parquet 22612709 21870590 1.03
tpcds_q90/datafusion:parquet 🚨 15896478 14078139 1.13
tpcds_q91/datafusion:parquet 61899394 57028170 1.09
tpcds_q92/datafusion:parquet 18307470 17306736 1.06
tpcds_q93/datafusion:parquet 31265563 31129881 1.00
tpcds_q94/datafusion:parquet 21652858 21911716 0.99
tpcds_q95/datafusion:parquet 62443068 60030353 1.04
tpcds_q96/datafusion:parquet 🚨 13297303 11473563 1.16
tpcds_q97/datafusion:parquet 30768088 31352140 0.98
tpcds_q98/datafusion:parquet 🚨 24469210 21282660 1.15
tpcds_q99/datafusion:parquet 26985685 25287461 1.07
duckdb / vortex-file-compressed (1.059x ➖, 1↑ 19↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24867481 23615569 1.05
tpcds_q02/duckdb:vortex-file-compressed 🚀 28573999 33280188 0.86
tpcds_q03/duckdb:vortex-file-compressed 16230332 14970525 1.08
tpcds_q04/duckdb:vortex-file-compressed 98196680 94404631 1.04
tpcds_q05/duckdb:vortex-file-compressed 35128525 32898759 1.07
tpcds_q06/duckdb:vortex-file-compressed 34487168 34204846 1.01
tpcds_q07/duckdb:vortex-file-compressed 22693156 21914540 1.04
tpcds_q08/duckdb:vortex-file-compressed 🚨 29241730 26057854 1.12
tpcds_q09/duckdb:vortex-file-compressed 16092571 16983017 0.95
tpcds_q10/duckdb:vortex-file-compressed 40400992 37389406 1.08
tpcds_q11/duckdb:vortex-file-compressed 69748153 65105880 1.07
tpcds_q12/duckdb:vortex-file-compressed 🚨 17098447 15440549 1.11
tpcds_q13/duckdb:vortex-file-compressed 33496873 32400957 1.03
tpcds_q14/duckdb:vortex-file-compressed 101367838 96375489 1.05
tpcds_q15/duckdb:vortex-file-compressed 🚨 29438988 26271321 1.12
tpcds_q16/duckdb:vortex-file-compressed 27725201 25640594 1.08
tpcds_q17/duckdb:vortex-file-compressed 47384938 45996135 1.03
tpcds_q18/duckdb:vortex-file-compressed 39796148 36970959 1.08
tpcds_q19/duckdb:vortex-file-compressed 🚨 35253516 31925659 1.10
tpcds_q20/duckdb:vortex-file-compressed 18169381 17100131 1.06
tpcds_q21/duckdb:vortex-file-compressed 17480200 16563481 1.06
tpcds_q22/duckdb:vortex-file-compressed 81711007 77593038 1.05
tpcds_q23/duckdb:vortex-file-compressed 100755847 98502944 1.02
tpcds_q24/duckdb:vortex-file-compressed 52091851 49061526 1.06
tpcds_q25/duckdb:vortex-file-compressed 43652430 41143278 1.06
tpcds_q26/duckdb:vortex-file-compressed 19829117 20294665 0.98
tpcds_q27/duckdb:vortex-file-compressed 24326207 23819027 1.02
tpcds_q28/duckdb:vortex-file-compressed 11860448 11913950 1.00
tpcds_q29/duckdb:vortex-file-compressed 43383930 41262649 1.05
tpcds_q30/duckdb:vortex-file-compressed 🚨 27208963 24675151 1.10
tpcds_q31/duckdb:vortex-file-compressed 28331186 29963445 0.95
tpcds_q32/duckdb:vortex-file-compressed 🚨 14600896 12884314 1.13
tpcds_q33/duckdb:vortex-file-compressed 25249907 24166886 1.04
tpcds_q34/duckdb:vortex-file-compressed 26605392 25825852 1.03
tpcds_q35/duckdb:vortex-file-compressed 67942390 65284389 1.04
tpcds_q36/duckdb:vortex-file-compressed 25027669 24961167 1.00
tpcds_q37/duckdb:vortex-file-compressed 21367654 19541781 1.09
tpcds_q38/duckdb:vortex-file-compressed 41192191 37852195 1.09
tpcds_q39/duckdb:vortex-file-compressed 37647576 35356587 1.06
tpcds_q40/duckdb:vortex-file-compressed 🚨 22368623 20261231 1.10
tpcds_q41/duckdb:vortex-file-compressed 9996106 9168140 1.09
tpcds_q42/duckdb:vortex-file-compressed 14390988 13111360 1.10
tpcds_q43/duckdb:vortex-file-compressed 🚨 22774650 20114592 1.13
tpcds_q44/duckdb:vortex-file-compressed 21865107 20473571 1.07
tpcds_q45/duckdb:vortex-file-compressed 33167359 30895517 1.07
tpcds_q46/duckdb:vortex-file-compressed 33267644 30301119 1.10
tpcds_q47/duckdb:vortex-file-compressed 56290330 52237831 1.08
tpcds_q48/duckdb:vortex-file-compressed 30468628 29137236 1.05
tpcds_q49/duckdb:vortex-file-compressed 🚨 38512095 34504592 1.12
tpcds_q50/duckdb:vortex-file-compressed 31503313 28783453 1.09
tpcds_q51/duckdb:vortex-file-compressed 107263995 105843656 1.01
tpcds_q52/duckdb:vortex-file-compressed 13496506 14090819 0.96
tpcds_q53/duckdb:vortex-file-compressed 🚨 25189510 21995822 1.15
tpcds_q54/duckdb:vortex-file-compressed 29911395 28717414 1.04
tpcds_q55/duckdb:vortex-file-compressed 13438941 12723719 1.06
tpcds_q56/duckdb:vortex-file-compressed 26716099 25644049 1.04
tpcds_q57/duckdb:vortex-file-compressed 44242468 43014575 1.03
tpcds_q58/duckdb:vortex-file-compressed 33056899 30445354 1.09
tpcds_q59/duckdb:vortex-file-compressed 57830012 55928247 1.03
tpcds_q60/duckdb:vortex-file-compressed 27315965 25910338 1.05
tpcds_q61/duckdb:vortex-file-compressed 33307157 32777310 1.02
tpcds_q62/duckdb:vortex-file-compressed 🚨 17091299 15080429 1.13
tpcds_q63/duckdb:vortex-file-compressed 22171355 20388813 1.09
tpcds_q64/duckdb:vortex-file-compressed 103301528 94883586 1.09
tpcds_q65/duckdb:vortex-file-compressed 24197784 22586233 1.07
tpcds_q66/duckdb:vortex-file-compressed 31330853 30104879 1.04
tpcds_q67/duckdb:vortex-file-compressed 149638461 140884203 1.06
tpcds_q68/duckdb:vortex-file-compressed 33102384 31081755 1.07
tpcds_q69/duckdb:vortex-file-compressed 43653940 39947042 1.09
tpcds_q70/duckdb:vortex-file-compressed 37376259 37492733 1.00
tpcds_q71/duckdb:vortex-file-compressed 21852279 20714468 1.05
tpcds_q72/duckdb:vortex-file-compressed 175856818 169731628 1.04
tpcds_q73/duckdb:vortex-file-compressed 26047331 25913154 1.01
tpcds_q74/duckdb:vortex-file-compressed 🚨 46530476 42062033 1.11
tpcds_q75/duckdb:vortex-file-compressed 52697540 53537909 0.98
tpcds_q76/duckdb:vortex-file-compressed 🚨 22898969 20550785 1.11
tpcds_q77/duckdb:vortex-file-compressed 25561914 24643766 1.04
tpcds_q78/duckdb:vortex-file-compressed 84008055 80392051 1.04
tpcds_q79/duckdb:vortex-file-compressed 24881542 25112417 0.99
tpcds_q80/duckdb:vortex-file-compressed 🚨 53070373 47570785 1.12
tpcds_q81/duckdb:vortex-file-compressed 32186185 29829365 1.08
tpcds_q82/duckdb:vortex-file-compressed 48246409 46080100 1.05
tpcds_q83/duckdb:vortex-file-compressed 32571436 31421438 1.04
tpcds_q84/duckdb:vortex-file-compressed 🚨 18842464 16782982 1.12
tpcds_q85/duckdb:vortex-file-compressed 44341052 41098095 1.08
tpcds_q86/duckdb:vortex-file-compressed 17074894 16547040 1.03
tpcds_q87/duckdb:vortex-file-compressed 43683973 41770184 1.05
tpcds_q88/duckdb:vortex-file-compressed 🚨 58780867 51151183 1.15
tpcds_q89/duckdb:vortex-file-compressed 23152191 21671835 1.07
tpcds_q90/duckdb:vortex-file-compressed 🚨 11841625 10196314 1.16
tpcds_q91/duckdb:vortex-file-compressed 24583585 22727614 1.08
tpcds_q92/duckdb:vortex-file-compressed 🚨 20444985 18335172 1.12
tpcds_q93/duckdb:vortex-file-compressed 33489613 30455362 1.10
tpcds_q94/duckdb:vortex-file-compressed 🚨 24367269 22066736 1.10
tpcds_q95/duckdb:vortex-file-compressed 162733674 154448835 1.05
tpcds_q96/duckdb:vortex-file-compressed 12657337 11817671 1.07
tpcds_q97/duckdb:vortex-file-compressed 39638504 38265650 1.04
tpcds_q98/duckdb:vortex-file-compressed 20859545 20727579 1.01
tpcds_q99/duckdb:vortex-file-compressed 23655330 22569761 1.05
duckdb / vortex-compact (1.045x ➖, 0↑ 11↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26606228 26231514 1.01
tpcds_q02/duckdb:vortex-compact 🚨 43290215 38427300 1.13
tpcds_q03/duckdb:vortex-compact 46954108 45487500 1.03
tpcds_q04/duckdb:vortex-compact 107377777 100573446 1.07
tpcds_q05/duckdb:vortex-compact 42990861 41473612 1.04
tpcds_q06/duckdb:vortex-compact 41196152 39327724 1.05
tpcds_q07/duckdb:vortex-compact 35986299 35009529 1.03
tpcds_q08/duckdb:vortex-compact 40775878 41650750 0.98
tpcds_q09/duckdb:vortex-compact 20809705 19855769 1.05
tpcds_q10/duckdb:vortex-compact 54191104 52901479 1.02
tpcds_q11/duckdb:vortex-compact 78078386 74483073 1.05
tpcds_q12/duckdb:vortex-compact 24003462 22171045 1.08
tpcds_q13/duckdb:vortex-compact 55367851 54122880 1.02
tpcds_q14/duckdb:vortex-compact 123554574 119968742 1.03
tpcds_q15/duckdb:vortex-compact 32089412 29870797 1.07
tpcds_q16/duckdb:vortex-compact 29302075 26857243 1.09
tpcds_q17/duckdb:vortex-compact 60167363 55177881 1.09
tpcds_q18/duckdb:vortex-compact 53750806 50844694 1.06
tpcds_q19/duckdb:vortex-compact 46137520 43522084 1.06
tpcds_q20/duckdb:vortex-compact 23176882 22118471 1.05
tpcds_q21/duckdb:vortex-compact 🚨 20860903 18089290 1.15
tpcds_q22/duckdb:vortex-compact 79184280 81432516 0.97
tpcds_q23/duckdb:vortex-compact 112996673 110830637 1.02
tpcds_q24/duckdb:vortex-compact 57381504 57089948 1.01
tpcds_q25/duckdb:vortex-compact 56471324 58619116 0.96
tpcds_q26/duckdb:vortex-compact 32417706 32708963 0.99
tpcds_q27/duckdb:vortex-compact 36670473 37420279 0.98
tpcds_q28/duckdb:vortex-compact 35445551 34092165 1.04
tpcds_q29/duckdb:vortex-compact 54855244 52072944 1.05
tpcds_q30/duckdb:vortex-compact 31840567 30255922 1.05
tpcds_q31/duckdb:vortex-compact 37320258 36255749 1.03
tpcds_q32/duckdb:vortex-compact 22844907 21815397 1.05
tpcds_q33/duckdb:vortex-compact 34697478 34527176 1.00
tpcds_q34/duckdb:vortex-compact 30844567 30812475 1.00
tpcds_q35/duckdb:vortex-compact 77774731 76122006 1.02
tpcds_q36/duckdb:vortex-compact 35572705 35230779 1.01
tpcds_q37/duckdb:vortex-compact 25316431 23573037 1.07
tpcds_q38/duckdb:vortex-compact 43862962 42311572 1.04
tpcds_q39/duckdb:vortex-compact 39973144 38230977 1.05
tpcds_q40/duckdb:vortex-compact 25503375 23666163 1.08
tpcds_q41/duckdb:vortex-compact 11632007 10703561 1.09
tpcds_q42/duckdb:vortex-compact 19719218 19231818 1.03
tpcds_q43/duckdb:vortex-compact 32643745 31177015 1.05
tpcds_q44/duckdb:vortex-compact 30951902 28939229 1.07
tpcds_q45/duckdb:vortex-compact 37703076 37542508 1.00
tpcds_q46/duckdb:vortex-compact 🚨 49904482 44407377 1.12
tpcds_q47/duckdb:vortex-compact 65717142 63432832 1.04
tpcds_q48/duckdb:vortex-compact 45525068 45262726 1.01
tpcds_q49/duckdb:vortex-compact 49585229 51799641 0.96
tpcds_q50/duckdb:vortex-compact 38962667 37440510 1.04
tpcds_q51/duckdb:vortex-compact 113687417 112859478 1.01
tpcds_q52/duckdb:vortex-compact 20618652 19024666 1.08
tpcds_q53/duckdb:vortex-compact 34263249 32445192 1.06
tpcds_q54/duckdb:vortex-compact 38687652 36309310 1.07
tpcds_q55/duckdb:vortex-compact 20524712 20096684 1.02
tpcds_q56/duckdb:vortex-compact 35478808 34558811 1.03
tpcds_q57/duckdb:vortex-compact 46340715 45035979 1.03
tpcds_q58/duckdb:vortex-compact 38869124 36437037 1.07
tpcds_q59/duckdb:vortex-compact 69318893 67741620 1.02
tpcds_q60/duckdb:vortex-compact 38482390 36119290 1.07
tpcds_q61/duckdb:vortex-compact 54942066 54854707 1.00
tpcds_q62/duckdb:vortex-compact 21833371 20038090 1.09
tpcds_q63/duckdb:vortex-compact 32677276 31236998 1.05
tpcds_q64/duckdb:vortex-compact 132862265 124692281 1.07
tpcds_q65/duckdb:vortex-compact 31742348 30857435 1.03
tpcds_q66/duckdb:vortex-compact 37415495 35245022 1.06
tpcds_q67/duckdb:vortex-compact 159458869 150898210 1.06
tpcds_q68/duckdb:vortex-compact 45890652 45482820 1.01
tpcds_q69/duckdb:vortex-compact 58072088 55226211 1.05
tpcds_q70/duckdb:vortex-compact 59083819 58364329 1.01
tpcds_q71/duckdb:vortex-compact 31277341 29184062 1.07
tpcds_q72/duckdb:vortex-compact 188204946 189569951 0.99
tpcds_q73/duckdb:vortex-compact 28881510 28569176 1.01
tpcds_q74/duckdb:vortex-compact 50218417 49357138 1.02
tpcds_q75/duckdb:vortex-compact 65933136 62473316 1.06
tpcds_q76/duckdb:vortex-compact 🚨 36435079 30710583 1.19
tpcds_q77/duckdb:vortex-compact 39164050 38362173 1.02
tpcds_q78/duckdb:vortex-compact 91981372 85984886 1.07
tpcds_q79/duckdb:vortex-compact 42371199 42199283 1.00
tpcds_q80/duckdb:vortex-compact 🚨 78732921 70733334 1.11
tpcds_q81/duckdb:vortex-compact 36098974 33708429 1.07
tpcds_q82/duckdb:vortex-compact 51580281 50330470 1.02
tpcds_q83/duckdb:vortex-compact 38156167 36764434 1.04
tpcds_q84/duckdb:vortex-compact 🚨 23373643 21197792 1.10
tpcds_q85/duckdb:vortex-compact 🚨 58569054 51726644 1.13
tpcds_q86/duckdb:vortex-compact 🚨 22014550 19785048 1.11
tpcds_q87/duckdb:vortex-compact 48025330 46674817 1.03
tpcds_q88/duckdb:vortex-compact 80602769 76496183 1.05
tpcds_q89/duckdb:vortex-compact 33105041 33132957 1.00
tpcds_q90/duckdb:vortex-compact 🚨 12498343 11183627 1.12
tpcds_q91/duckdb:vortex-compact 🚨 44549580 39837463 1.12
tpcds_q92/duckdb:vortex-compact 43338582 47546971 0.91
tpcds_q93/duckdb:vortex-compact 35044065 32345488 1.08
tpcds_q94/duckdb:vortex-compact 🚨 30225482 27222152 1.11
tpcds_q95/duckdb:vortex-compact 170351542 167343385 1.02
tpcds_q96/duckdb:vortex-compact 17269458 15836246 1.09
tpcds_q97/duckdb:vortex-compact 44811255 41771022 1.07
tpcds_q98/duckdb:vortex-compact 27960914 27444588 1.02
tpcds_q99/duckdb:vortex-compact 27472959 26147775 1.05
duckdb / parquet (1.035x ➖, 0↑ 4↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31420125 29878127 1.05
tpcds_q02/duckdb:parquet 25049601 24070828 1.04
tpcds_q03/duckdb:parquet 13089193 12672946 1.03
tpcds_q04/duckdb:parquet 174248661 168949348 1.03
tpcds_q05/duckdb:parquet 32934905 32411143 1.02
tpcds_q06/duckdb:parquet 35010357 33965791 1.03
tpcds_q07/duckdb:parquet 24781417 24306386 1.02
tpcds_q08/duckdb:parquet 29943431 29847573 1.00
tpcds_q09/duckdb:parquet 45184544 44231287 1.02
tpcds_q10/duckdb:parquet 39036717 38894438 1.00
tpcds_q11/duckdb:parquet 92799518 94932341 0.98
tpcds_q12/duckdb:parquet 18155329 17258382 1.05
tpcds_q13/duckdb:parquet 36231901 35060339 1.03
tpcds_q14/duckdb:parquet 106497996 101905930 1.05
tpcds_q15/duckdb:parquet 32516482 30808694 1.06
tpcds_q16/duckdb:parquet 23691595 22910736 1.03
tpcds_q17/duckdb:parquet 40860716 40333378 1.01
tpcds_q18/duckdb:parquet 51059573 48310525 1.06
tpcds_q19/duckdb:parquet 32829464 31993908 1.03
tpcds_q20/duckdb:parquet 19598687 18540351 1.06
tpcds_q21/duckdb:parquet 12388728 11520620 1.08
tpcds_q22/duckdb:parquet 76416043 72570115 1.05
tpcds_q23/duckdb:parquet 84072265 82153758 1.02
tpcds_q24/duckdb:parquet 48875619 46982145 1.04
tpcds_q25/duckdb:parquet 37211086 35696703 1.04
tpcds_q26/duckdb:parquet 41630428 39464859 1.05
tpcds_q27/duckdb:parquet 55632406 53832081 1.03
tpcds_q28/duckdb:parquet 43165810 42598434 1.01
tpcds_q29/duckdb:parquet 39310537 36794501 1.07
tpcds_q30/duckdb:parquet 38438105 37707492 1.02
tpcds_q31/duckdb:parquet 26977907 27769462 0.97
tpcds_q32/duckdb:parquet 13401017 12627273 1.06
tpcds_q33/duckdb:parquet 24338743 24029831 1.01
tpcds_q34/duckdb:parquet 23055911 23360836 0.99
tpcds_q35/duckdb:parquet 63737736 61453012 1.04
tpcds_q36/duckdb:parquet 23210771 22654379 1.02
tpcds_q37/duckdb:parquet 15834524 14600297 1.08
tpcds_q38/duckdb:parquet 37915848 37518028 1.01
tpcds_q39/duckdb:parquet 33292708 32202265 1.03
tpcds_q40/duckdb:parquet 20933775 19100843 1.10
tpcds_q41/duckdb:parquet 9319623 8968837 1.04
tpcds_q42/duckdb:parquet 12606052 12520724 1.01
tpcds_q43/duckdb:parquet 18312929 16718686 1.10
tpcds_q44/duckdb:parquet 26743902 25551857 1.05
tpcds_q45/duckdb:parquet 29621983 28797307 1.03
tpcds_q46/duckdb:parquet 49837297 47178697 1.06
tpcds_q47/duckdb:parquet 51607583 49765389 1.04
tpcds_q48/duckdb:parquet 34018947 32612976 1.04
tpcds_q49/duckdb:parquet 29252777 28551305 1.02
tpcds_q50/duckdb:parquet 27242687 26450853 1.03
tpcds_q51/duckdb:parquet 107445024 104025621 1.03
tpcds_q52/duckdb:parquet 12789320 12993075 0.98
tpcds_q53/duckdb:parquet 19482035 19335771 1.01
tpcds_q54/duckdb:parquet 29684863 29000298 1.02
tpcds_q55/duckdb:parquet 12404063 12414119 1.00
tpcds_q56/duckdb:parquet 24026382 24937798 0.96
tpcds_q57/duckdb:parquet 🚨 47373119 38023618 1.25
tpcds_q58/duckdb:parquet 27831587 25828806 1.08
tpcds_q59/duckdb:parquet 37069082 36554420 1.01
tpcds_q60/duckdb:parquet 25438538 24588660 1.03
tpcds_q61/duckdb:parquet 32840326 33737067 0.97
tpcds_q62/duckdb:parquet 13119148 12440329 1.05
tpcds_q63/duckdb:parquet 18131940 17485096 1.04
tpcds_q64/duckdb:parquet 83421971 77671559 1.07
tpcds_q65/duckdb:parquet 23281792 24613036 0.95
tpcds_q66/duckdb:parquet 29968273 29600617 1.01
tpcds_q67/duckdb:parquet 142108245 137031353 1.04
tpcds_q68/duckdb:parquet 39824163 39444297 1.01
tpcds_q69/duckdb:parquet 39416141 38561142 1.02
tpcds_q70/duckdb:parquet 22612790 22815801 0.99
tpcds_q71/duckdb:parquet 23373219 22961241 1.02
tpcds_q72/duckdb:parquet 169955731 167336228 1.02
tpcds_q73/duckdb:parquet 20515552 21033722 0.98
tpcds_q74/duckdb:parquet 131020669 128402754 1.02
tpcds_q75/duckdb:parquet 59796348 57615249 1.04
tpcds_q76/duckdb:parquet 22803059 21875820 1.04
tpcds_q77/duckdb:parquet 25783253 25094490 1.03
tpcds_q78/duckdb:parquet 81501586 77689076 1.05
tpcds_q79/duckdb:parquet 30870288 30353241 1.02
tpcds_q80/duckdb:parquet 🚨 48460350 43490581 1.11
tpcds_q81/duckdb:parquet 36046144 35666177 1.01
tpcds_q82/duckdb:parquet 17140819 15931106 1.08
tpcds_q83/duckdb:parquet 19671129 18185173 1.08
tpcds_q84/duckdb:parquet 21210382 20520960 1.03
tpcds_q85/duckdb:parquet 42688060 42565069 1.00
tpcds_q86/duckdb:parquet 🚨 15987486 13483285 1.19
tpcds_q87/duckdb:parquet 41362048 39480362 1.05
tpcds_q88/duckdb:parquet 54616501 52654856 1.04
tpcds_q89/duckdb:parquet 21167560 21527081 0.98
tpcds_q90/duckdb:parquet 🚨 9798123 8337180 1.18
tpcds_q91/duckdb:parquet 26181481 24663343 1.06
tpcds_q92/duckdb:parquet 13849239 12971907 1.07
tpcds_q93/duckdb:parquet 33375311 32026369 1.04
tpcds_q94/duckdb:parquet 18735549 18189698 1.03
tpcds_q95/duckdb:parquet 154132600 145261521 1.06
tpcds_q96/duckdb:parquet 10727030 10437844 1.03
tpcds_q97/duckdb:parquet 39570711 40352863 0.98
tpcds_q98/duckdb:parquet 24389194 24872840 0.98
tpcds_q99/duckdb:parquet 20850163 20125947 1.04
duckdb / duckdb (1.052x ➖, 1↑ 15↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 23508460 22244144 1.06
tpcds_q02/duckdb:duckdb 20663682 19908984 1.04
tpcds_q03/duckdb:duckdb 10918946 10470555 1.04
tpcds_q04/duckdb:duckdb 185008069 180039000 1.03
tpcds_q05/duckdb:duckdb 22406822 21158335 1.06
tpcds_q06/duckdb:duckdb 29056242 28397890 1.02
tpcds_q07/duckdb:duckdb 42368379 40172256 1.05
tpcds_q08/duckdb:duckdb 122072837 120466777 1.01
tpcds_q09/duckdb:duckdb 21302715 20636697 1.03
tpcds_q10/duckdb:duckdb 28219708 28689743 0.98
tpcds_q11/duckdb:duckdb 🚨 103028251 90817600 1.13
tpcds_q12/duckdb:duckdb 14649753 14009447 1.05
tpcds_q13/duckdb:duckdb 27299700 26326623 1.04
tpcds_q14/duckdb:duckdb 97026818 94664723 1.02
tpcds_q15/duckdb:duckdb 26191021 24965069 1.05
tpcds_q16/duckdb:duckdb 🚨 21621586 19402568 1.11
tpcds_q17/duckdb:duckdb 26379520 24205134 1.09
tpcds_q18/duckdb:duckdb 49578215 48457538 1.02
tpcds_q19/duckdb:duckdb 19990600 19769234 1.01
tpcds_q20/duckdb:duckdb 14998341 14473913 1.04
tpcds_q21/duckdb:duckdb 8145532 7778203 1.05
tpcds_q22/duckdb:duckdb 66430673 63167158 1.05
tpcds_q23/duckdb:duckdb 🚨 86134812 77287476 1.11
tpcds_q24/duckdb:duckdb 🚨 29410907 25257288 1.16
tpcds_q25/duckdb:duckdb 19916328 18625483 1.07
tpcds_q26/duckdb:duckdb 29977650 28297739 1.06
tpcds_q27/duckdb:duckdb 43297363 41910400 1.03
tpcds_q28/duckdb:duckdb 27661088 26846596 1.03
tpcds_q29/duckdb:duckdb 24668034 24123975 1.02
tpcds_q30/duckdb:duckdb 🚨 34822936 31418165 1.11
tpcds_q31/duckdb:duckdb 55553403 51496674 1.08
tpcds_q32/duckdb:duckdb 8473857 8169075 1.04
tpcds_q33/duckdb:duckdb 17269376 16480456 1.05
tpcds_q34/duckdb:duckdb 🚨 21997843 18533109 1.19
tpcds_q35/duckdb:duckdb 39806861 37982682 1.05
tpcds_q36/duckdb:duckdb 76627252 71367627 1.07
tpcds_q37/duckdb:duckdb 9349869 8781893 1.06
tpcds_q38/duckdb:duckdb 37984725 39618224 0.96
tpcds_q39/duckdb:duckdb 29265387 28383768 1.03
tpcds_q40/duckdb:duckdb 15493700 14870319 1.04
tpcds_q41/duckdb:duckdb 10175866 9258061 1.10
tpcds_q42/duckdb:duckdb 8968010 8439021 1.06
tpcds_q43/duckdb:duckdb 15157842 14951815 1.01
tpcds_q44/duckdb:duckdb 15772883 15179791 1.04
tpcds_q45/duckdb:duckdb 19834742 18755076 1.06
tpcds_q46/duckdb:duckdb 🚨 44312446 38425587 1.15
tpcds_q47/duckdb:duckdb 48132857 46705879 1.03
tpcds_q48/duckdb:duckdb 26429204 24576705 1.08
tpcds_q49/duckdb:duckdb 20647501 21379811 0.97
tpcds_q50/duckdb:duckdb 16634431 16308058 1.02
tpcds_q51/duckdb:duckdb 103921968 100078578 1.04
tpcds_q52/duckdb:duckdb 🚀 9493509 10613962 0.89
tpcds_q53/duckdb:duckdb 18196674 17978672 1.01
tpcds_q54/duckdb:duckdb 🚨 20711075 18586829 1.11
tpcds_q55/duckdb:duckdb 9898735 9867917 1.00
tpcds_q56/duckdb:duckdb 17245341 17429627 0.99
tpcds_q57/duckdb:duckdb 37931430 36835511 1.03
tpcds_q58/duckdb:duckdb 19001504 17448161 1.09
tpcds_q59/duckdb:duckdb 37816473 36838079 1.03
tpcds_q60/duckdb:duckdb 19543959 18679235 1.05
tpcds_q61/duckdb:duckdb 17475737 16774446 1.04
tpcds_q62/duckdb:duckdb 10504596 9838800 1.07
tpcds_q63/duckdb:duckdb 17126536 16436855 1.04
tpcds_q64/duckdb:duckdb 60222593 58895470 1.02
tpcds_q65/duckdb:duckdb 38254713 36204817 1.06
tpcds_q66/duckdb:duckdb 27792038 26220555 1.06
tpcds_q67/duckdb:duckdb 135246570 133435626 1.01
tpcds_q68/duckdb:duckdb 🚨 30307248 27007456 1.12
tpcds_q69/duckdb:duckdb 29971504 28976840 1.03
tpcds_q70/duckdb:duckdb 🚨 18968795 16230963 1.17
tpcds_q71/duckdb:duckdb 16298456 16958843 0.96
tpcds_q72/duckdb:duckdb 47568597 45525661 1.04
tpcds_q73/duckdb:duckdb 15059861 13773292 1.09
tpcds_q74/duckdb:duckdb 152263286 145069610 1.05
tpcds_q75/duckdb:duckdb 48371098 46144132 1.05
tpcds_q76/duckdb:duckdb 15824727 14850830 1.07
tpcds_q77/duckdb:duckdb 15890116 15907705 1.00
tpcds_q78/duckdb:duckdb 68985003 66717092 1.03
tpcds_q79/duckdb:duckdb 🚨 23548364 20949990 1.12
tpcds_q80/duckdb:duckdb 33338132 31723731 1.05
tpcds_q81/duckdb:duckdb 43861524 40541718 1.08
tpcds_q82/duckdb:duckdb 10967970 10577498 1.04
tpcds_q83/duckdb:duckdb 🚨 11888396 10786104 1.10
tpcds_q84/duckdb:duckdb 🚨 18846937 14949418 1.26
tpcds_q85/duckdb:duckdb 27728752 25243834 1.10
tpcds_q86/duckdb:duckdb 🚨 13296207 11961227 1.11
tpcds_q87/duckdb:duckdb 🚨 40272503 35562424 1.13
tpcds_q88/duckdb:duckdb 31394036 30310818 1.04
tpcds_q89/duckdb:duckdb 22690262 23310541 0.97
tpcds_q90/duckdb:duckdb 6903754 6422831 1.07
tpcds_q91/duckdb:duckdb 15801332 15281129 1.03
tpcds_q92/duckdb:duckdb 10491125 10265009 1.02
tpcds_q93/duckdb:duckdb 25279643 23853133 1.06
tpcds_q94/duckdb:duckdb 15205842 14525967 1.05
tpcds_q95/duckdb:duckdb 138710896 130524219 1.06
tpcds_q96/duckdb:duckdb 6288617 5894630 1.07
tpcds_q97/duckdb:duckdb 33382431 32506737 1.03
tpcds_q98/duckdb:duckdb 20774261 20917947 0.99
tpcds_q99/duckdb:duckdb 17392225 16561818 1.05
File Size Changes (6 files changed, +0.0% overall, 1↑ 5↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.26 MB +89.76 KB +2.1%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.64 MB 24 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 565.71 KB 565.63 KB 80 B -0.0%
item.vortex 1.0 vortex-compact 994.82 KB 994.68 KB 144 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 826.49 KB 825.30 KB 1.19 KB -0.1%
time_dim.vortex 1.0 vortex-file-compressed 385.70 KB 379.95 KB 5.75 KB -1.5%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 269.95 MB → 270.03 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.0%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.031x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 45793674 34982728 1.31
fineweb_q01/datafusion:vortex-file-compressed 792051845 691537632 1.15
fineweb_q02/datafusion:vortex-file-compressed 943570353 995879292 0.95
fineweb_q03/datafusion:vortex-file-compressed 1137117428 1276103710 0.89
fineweb_q04/datafusion:vortex-file-compressed 1180068357 1194230005 0.99
fineweb_q05/datafusion:vortex-file-compressed 1096943733 1098238416 1.00
fineweb_q06/datafusion:vortex-file-compressed 1354250004 1297732805 1.04
fineweb_q07/datafusion:vortex-file-compressed 1263636230 1154079141 1.09
fineweb_q08/datafusion:vortex-file-compressed 475871999 515483460 0.92
datafusion / vortex-compact (0.918x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33154426 43756158 0.76
fineweb_q01/datafusion:vortex-compact 908037912 862147843 1.05
fineweb_q02/datafusion:vortex-compact 1272907290 1335475467 0.95
fineweb_q03/datafusion:vortex-compact 1443978863 1453526396 0.99
fineweb_q04/datafusion:vortex-compact 1645201002 1706523768 0.96
fineweb_q05/datafusion:vortex-compact 1391991734 1460367051 0.95
fineweb_q06/datafusion:vortex-compact 1335524965 1562379705 0.85
fineweb_q07/datafusion:vortex-compact 1277973006 1174188900 1.09
fineweb_q08/datafusion:vortex-compact 420112607 585420754 0.72
datafusion / parquet (0.973x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1289769880 1430056584 0.90
fineweb_q01/datafusion:parquet 2009397297 1982474174 1.01
fineweb_q02/datafusion:parquet 2149385594 2082709835 1.03
fineweb_q03/datafusion:parquet 2068936898 1869126955 1.11
fineweb_q04/datafusion:parquet 2198809565 2275057280 0.97
fineweb_q05/datafusion:parquet 2045047043 2486894898 0.82
fineweb_q06/datafusion:parquet 2340014905 2613721436 0.90
fineweb_q07/datafusion:parquet 2156395940 2215719164 0.97
fineweb_q08/datafusion:parquet 2543023545 2350779116 1.08
duckdb / vortex-file-compressed (0.927x ➖, 1↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 78252944 140519615 0.56
fineweb_q01/duckdb:vortex-file-compressed 751517667 781475459 0.96
fineweb_q02/duckdb:vortex-file-compressed 751124905 899916156 0.83
fineweb_q03/duckdb:vortex-file-compressed 1578513135 1615359736 0.98
fineweb_q04/duckdb:vortex-file-compressed 1801701259 1533054805 1.18
fineweb_q05/duckdb:vortex-file-compressed 1507869656 1555156691 0.97
fineweb_q06/duckdb:vortex-file-compressed 1684057243 1566854780 1.07
fineweb_q07/duckdb:vortex-file-compressed 1528981937 1432642798 1.07
fineweb_q08/duckdb:vortex-file-compressed 638892837 720142057 0.89
duckdb / vortex-compact (1.110x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 123594076 61368488 2.01
fineweb_q01/duckdb:vortex-compact 783866897 604493514 1.30
fineweb_q02/duckdb:vortex-compact 836787013 692594678 1.21
fineweb_q03/duckdb:vortex-compact 1793769764 1916369618 0.94
fineweb_q04/duckdb:vortex-compact 1947396953 2054097260 0.95
fineweb_q05/duckdb:vortex-compact 1782704814 1887097226 0.94
fineweb_q06/duckdb:vortex-compact 1719023133 1683885923 1.02
fineweb_q07/duckdb:vortex-compact 1541014131 1605130967 0.96
fineweb_q08/duckdb:vortex-compact 518740553 527335559 0.98
duckdb / parquet (1.022x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1197095315 1198909896 1.00
fineweb_q01/duckdb:parquet 1394584966 1359766280 1.03
fineweb_q02/duckdb:parquet 1473389827 1388800663 1.06
fineweb_q03/duckdb:parquet 4069958153 3953777974 1.03
fineweb_q04/duckdb:parquet 2139335823 2058032430 1.04
fineweb_q05/duckdb:parquet 2553726582 2456075407 1.04
fineweb_q06/duckdb:parquet 4774091123 4748499853 1.01
fineweb_q07/duckdb:parquet 2872228226 2803697744 1.02
fineweb_q08/duckdb:parquet 1266051551 1290161861 0.98

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 1.022x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.034x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12266764 11615698 1.06
statpopgen_q01/duckdb:vortex-file-compressed 🚨 29259125 26575621 1.10
statpopgen_q02/duckdb:vortex-file-compressed 522477279 522543572 1.00
statpopgen_q03/duckdb:vortex-file-compressed 1068515382 1040106128 1.03
statpopgen_q04/duckdb:vortex-file-compressed 1079521270 1054092848 1.02
statpopgen_q05/duckdb:vortex-file-compressed 489752139 451777017 1.08
statpopgen_q06/duckdb:vortex-file-compressed 1528312345 1531694182 1.00
statpopgen_q07/duckdb:vortex-file-compressed 307250350 299553913 1.03
statpopgen_q08/duckdb:vortex-file-compressed 344444560 333806039 1.03
statpopgen_q09/duckdb:vortex-file-compressed 834550340 825967904 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2580725970 2537709902 1.02
duckdb / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12010839 11748441 1.02
statpopgen_q01/duckdb:vortex-compact 218325730 212954036 1.03
statpopgen_q02/duckdb:vortex-compact 565716292 556257807 1.02
statpopgen_q03/duckdb:vortex-compact 1156093568 1161815412 1.00
statpopgen_q04/duckdb:vortex-compact 1179631940 1171294476 1.01
statpopgen_q05/duckdb:vortex-compact 575118297 564304792 1.02
statpopgen_q06/duckdb:vortex-compact 1507386253 1512083534 1.00
statpopgen_q07/duckdb:vortex-compact 894085939 890891579 1.00
statpopgen_q08/duckdb:vortex-compact 927307389 917133304 1.01
statpopgen_q09/duckdb:vortex-compact 936914705 930755993 1.01
statpopgen_q10/duckdb:vortex-compact 2626916445 2599446944 1.01
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307859116 305073545 1.01
statpopgen_q01/duckdb:parquet 390266778 386209597 1.01
statpopgen_q02/duckdb:parquet 778573933 765079535 1.02
statpopgen_q03/duckdb:parquet 1204896905 1191652941 1.01
statpopgen_q04/duckdb:parquet 1204554470 1179912232 1.02
statpopgen_q05/duckdb:parquet 823440478 816895279 1.01
statpopgen_q06/duckdb:parquet 1447637271 1424051123 1.02
statpopgen_q07/duckdb:parquet 855170524 885509401 0.97
statpopgen_q08/duckdb:parquet 883242029 856573798 1.03
statpopgen_q09/duckdb:parquet 1010461224 1015010641 1.00
statpopgen_q10/duckdb:parquet 2217119044 2232466750 0.99
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.83 GB 1.83 GB 15.81 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.83 GB → 1.83 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.9%
Engines: DataFusion No clear signal (-11.6%, environment too noisy confidence) · DuckDB No clear signal (+2.4%, environment too noisy confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.989x ➖, 0↑ 2↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 277230013 291815451 0.95
tpch_q02/datafusion:vortex-file-compressed 442608942 555297192 0.80
tpch_q03/datafusion:vortex-file-compressed 421732180 541427461 0.78
tpch_q04/datafusion:vortex-file-compressed 223041773 310402821 0.72
tpch_q05/datafusion:vortex-file-compressed 394063929 464650209 0.85
tpch_q06/datafusion:vortex-file-compressed 315927600 342488409 0.92
tpch_q07/datafusion:vortex-file-compressed 434319283 478116898 0.91
tpch_q08/datafusion:vortex-file-compressed 826517803 682569695 1.21
tpch_q09/datafusion:vortex-file-compressed 540120787 496284220 1.09
tpch_q10/datafusion:vortex-file-compressed 486019322 595393403 0.82
tpch_q11/datafusion:vortex-file-compressed 282307803 370577650 0.76
tpch_q12/datafusion:vortex-file-compressed 407452624 439693464 0.93
tpch_q13/datafusion:vortex-file-compressed 215418124 204862201 1.05
tpch_q14/datafusion:vortex-file-compressed 291939857 239709539 1.22
tpch_q15/datafusion:vortex-file-compressed 521169707 453981928 1.15
tpch_q16/datafusion:vortex-file-compressed 216570310 223436338 0.97
tpch_q17/datafusion:vortex-file-compressed 🚨 660417127 504057732 1.31
tpch_q18/datafusion:vortex-file-compressed 418463457 443322326 0.94
tpch_q19/datafusion:vortex-file-compressed 678697623 705540528 0.96
tpch_q20/datafusion:vortex-file-compressed 494969897 434942177 1.14
tpch_q21/datafusion:vortex-file-compressed 645206723 550673827 1.17
tpch_q22/datafusion:vortex-file-compressed 🚨 244167950 161951390 1.51
datafusion / vortex-compact (1.028x ➖, 1↑ 4↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 317233988 351462218 0.90
tpch_q02/datafusion:vortex-compact 573359745 720806528 0.80
tpch_q03/datafusion:vortex-compact 517119537 431182479 1.20
tpch_q04/datafusion:vortex-compact 254497606 212488364 1.20
tpch_q05/datafusion:vortex-compact 493655528 427941180 1.15
tpch_q06/datafusion:vortex-compact 329188907 363590985 0.91
tpch_q07/datafusion:vortex-compact 578293635 515093876 1.12
tpch_q08/datafusion:vortex-compact 560514138 793232646 0.71
tpch_q09/datafusion:vortex-compact 406953676 558019972 0.73
tpch_q10/datafusion:vortex-compact 476335192 539274773 0.88
tpch_q11/datafusion:vortex-compact 364476593 325131097 1.12
tpch_q12/datafusion:vortex-compact 413507093 389641901 1.06
tpch_q13/datafusion:vortex-compact 218581609 208792732 1.05
tpch_q14/datafusion:vortex-compact 🚨 383308858 254926766 1.50
tpch_q15/datafusion:vortex-compact 🚨 617665904 457196928 1.35
tpch_q16/datafusion:vortex-compact 🚨 271964435 188253053 1.44
tpch_q17/datafusion:vortex-compact 🚨 474955077 346434948 1.37
tpch_q18/datafusion:vortex-compact 309536847 312325454 0.99
tpch_q19/datafusion:vortex-compact 639890250 612000034 1.05
tpch_q20/datafusion:vortex-compact 496357545 471673943 1.05
tpch_q21/datafusion:vortex-compact 517113858 553580282 0.93
tpch_q22/datafusion:vortex-compact 🚀 143240718 219830203 0.65
datafusion / parquet (1.141x ➖, 0↑ 7↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 256213787 276596427 0.93
tpch_q02/datafusion:parquet 500511686 442995889 1.13
tpch_q03/datafusion:parquet 410693043 384585782 1.07
tpch_q04/datafusion:parquet 259720762 292316471 0.89
tpch_q05/datafusion:parquet 🚨 747195226 482536173 1.55
tpch_q06/datafusion:parquet 🚨 290551870 221359519 1.31
tpch_q07/datafusion:parquet 🚨 742285292 516997170 1.44
tpch_q08/datafusion:parquet 743311435 699941790 1.06
tpch_q09/datafusion:parquet 501011213 518276673 0.97
tpch_q10/datafusion:parquet 452118590 494465304 0.91
tpch_q11/datafusion:parquet 368937646 374221434 0.99
tpch_q12/datafusion:parquet 🚨 307848761 217336719 1.42
tpch_q13/datafusion:parquet 422033069 425467086 0.99
tpch_q14/datafusion:parquet 🚨 262456739 175701495 1.49
tpch_q15/datafusion:parquet 🚨 629543490 287890878 2.19
tpch_q16/datafusion:parquet 🚨 391974591 182188602 2.15
tpch_q17/datafusion:parquet 543504693 624382347 0.87
tpch_q18/datafusion:parquet 434757859 494212247 0.88
tpch_q19/datafusion:parquet 354647718 412903431 0.86
tpch_q20/datafusion:parquet 344119539 321683494 1.07
tpch_q21/datafusion:parquet 550434399 591762421 0.93
tpch_q22/datafusion:parquet 202932660 194510537 1.04
duckdb / vortex-file-compressed (0.967x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 260401088 289229048 0.90
tpch_q02/duckdb:vortex-file-compressed 929225914 1076826354 0.86
tpch_q03/duckdb:vortex-file-compressed 566102452 606486566 0.93
tpch_q04/duckdb:vortex-file-compressed 368376483 399823352 0.92
tpch_q05/duckdb:vortex-file-compressed 795266763 796491889 1.00
tpch_q06/duckdb:vortex-file-compressed 337158960 338089226 1.00
tpch_q07/duckdb:vortex-file-compressed 924567622 872471981 1.06
tpch_q08/duckdb:vortex-file-compressed 976676895 999337359 0.98
tpch_q09/duckdb:vortex-file-compressed 911224111 917778040 0.99
tpch_q10/duckdb:vortex-file-compressed 671494508 731249890 0.92
tpch_q11/duckdb:vortex-file-compressed 498592999 446768478 1.12
tpch_q12/duckdb:vortex-file-compressed 640669627 629482277 1.02
tpch_q13/duckdb:vortex-file-compressed 424483644 464747509 0.91
tpch_q14/duckdb:vortex-file-compressed 367637922 350632757 1.05
tpch_q15/duckdb:vortex-file-compressed 283390765 328037931 0.86
tpch_q16/duckdb:vortex-file-compressed 330761194 347504948 0.95
tpch_q17/duckdb:vortex-file-compressed 683728997 653284217 1.05
tpch_q18/duckdb:vortex-file-compressed 441531469 487223498 0.91
tpch_q19/duckdb:vortex-file-compressed 490181680 459106025 1.07
tpch_q20/duckdb:vortex-file-compressed 718403172 775146944 0.93
tpch_q21/duckdb:vortex-file-compressed 958429211 959794276 1.00
tpch_q22/duckdb:vortex-file-compressed 302013832 334429660 0.90
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 313370426 305822231 1.02
tpch_q02/duckdb:vortex-compact 945400129 941802628 1.00
tpch_q03/duckdb:vortex-compact 566598762 671282575 0.84
tpch_q04/duckdb:vortex-compact 366493828 389169096 0.94
tpch_q05/duckdb:vortex-compact 859066470 760578235 1.13
tpch_q06/duckdb:vortex-compact 331566812 360364393 0.92
tpch_q07/duckdb:vortex-compact 911795287 850803757 1.07
tpch_q08/duckdb:vortex-compact 933185570 954824343 0.98
tpch_q09/duckdb:vortex-compact 888672361 903642416 0.98
tpch_q10/duckdb:vortex-compact 714290524 741112364 0.96
tpch_q11/duckdb:vortex-compact 466896951 464623076 1.00
tpch_q12/duckdb:vortex-compact 595837309 634025420 0.94
tpch_q13/duckdb:vortex-compact 387401967 456619783 0.85
tpch_q14/duckdb:vortex-compact 397810224 400450092 0.99
tpch_q15/duckdb:vortex-compact 260813341 273204876 0.95
tpch_q16/duckdb:vortex-compact 301264373 306679798 0.98
tpch_q17/duckdb:vortex-compact 688519923 641613886 1.07
tpch_q18/duckdb:vortex-compact 410267667 451000832 0.91
tpch_q19/duckdb:vortex-compact 483090457 531090551 0.91
tpch_q20/duckdb:vortex-compact 742409641 772263766 0.96
tpch_q21/duckdb:vortex-compact 893926879 842071403 1.06
tpch_q22/duckdb:vortex-compact 280072857 274417025 1.02
duckdb / parquet (0.948x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base b2c9e79 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 415166255 472313658 0.88
tpch_q02/duckdb:parquet 956488166 1077779795 0.89
tpch_q03/duckdb:parquet 929821860 1144182947 0.81
tpch_q04/duckdb:parquet 642799503 591782380 1.09
tpch_q05/duckdb:parquet 1241371872 1197952511 1.04
tpch_q06/duckdb:parquet 444531726 488236639 0.91
tpch_q07/duckdb:parquet 1121135011 1188614807 0.94
tpch_q08/duckdb:parquet 1504813390 1606771453 0.94
tpch_q09/duckdb:parquet 1247199190 1436222223 0.87
tpch_q10/duckdb:parquet 1249015154 1326845731 0.94
tpch_q11/duckdb:parquet 731195517 656844771 1.11
tpch_q12/duckdb:parquet 727256676 798976498 0.91
tpch_q13/duckdb:parquet 860865685 918298314 0.94
tpch_q14/duckdb:parquet 633761035 677343562 0.94
tpch_q15/duckdb:parquet 530204925 569722054 0.93
tpch_q16/duckdb:parquet 602574008 603513991 1.00
tpch_q17/duckdb:parquet 786390315 778192289 1.01
tpch_q18/duckdb:parquet 793915447 787879183 1.01
tpch_q19/duckdb:parquet 740403863 823729173 0.90
tpch_q20/duckdb:parquet 1012475775 1043942257 0.97
tpch_q21/duckdb:parquet 1024902697 1088634110 0.94
tpch_q22/duckdb:parquet 536658094 556547284 0.96

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.074x ➖
Parquet (geomean): 1.072x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.097x ➖, 1↑ 11↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1801170 367164 4.91
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1088517 1023929 1.06
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8474891710 8450092396 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8515664150 8172129664 1.04
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3573871 4007936 0.89
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 3081855 2900577 1.06
random-access/feature-vectors/uniform/lance-tokio-local-disk 1240775 1170476 1.06
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1922182 1805076 1.06
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8389597515 8169455006 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8359341308 8209463543 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3740676 3444035 1.09
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6290464 5732226 1.10
random-access/lance-tokio-local-disk 661266 625489 1.06
random-access/lance-tokio-local-disk-footer 1334555 1286271 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk 247586 237999 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 602220 576338 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk 136301355 128682119 1.06
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 135493590 128250223 1.06
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 532206 441333 1.21
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 680159 566291 1.20
random-access/nested-lists/uniform/lance-tokio-local-disk 1039366 994623 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1417863 1335342 1.06
random-access/nested-lists/uniform/parquet-tokio-local-disk 136852517 128087997 1.07
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 134430420 128725365 1.04
random-access/nested-lists/uniform/vortex-tokio-local-disk 2068733 1914028 1.08
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2225370 2033752 1.09
random-access/nested-structs/correlated/lance-tokio-local-disk 378230 362312 1.04
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 569605 539783 1.06
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 24991268 20978355 1.19
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 24896027 21323448 1.17
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 603197 509583 1.18
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 804646 702619 1.15
random-access/nested-structs/uniform/lance-tokio-local-disk 2781145 2603899 1.07
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2929421 2721535 1.08
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 24967985 21655397 1.15
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 24918813 21442044 1.16
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 1544217 1399617 1.10
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1681990 1532791 1.10
random-access/parquet-tokio-local-disk 175418865 166979993 1.05
random-access/parquet-tokio-local-disk-footer 175393871 166739279 1.05
random-access/taxi/correlated/lance-tokio-local-disk 976623 920904 1.06
random-access/taxi/correlated/lance-tokio-local-disk-footer 1934457 1787178 1.08
random-access/taxi/correlated/parquet-tokio-local-disk 263691906 251873020 1.05
random-access/taxi/correlated/parquet-tokio-local-disk-footer 263905770 249854010 1.06
random-access/taxi/correlated/vortex-tokio-local-disk 1186932 1218622 0.97
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 1826668 1648224 1.11
random-access/taxi/uniform/lance-tokio-local-disk 9518207 9401226 1.01
random-access/taxi/uniform/lance-tokio-local-disk-footer 10194067 9953854 1.02
random-access/taxi/uniform/parquet-tokio-local-disk 279226245 264179053 1.06
random-access/taxi/uniform/parquet-tokio-local-disk-footer 281187937 264901657 1.06
random-access/taxi/uniform/vortex-tokio-local-disk 3627147 3637336 1.00
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4449417 4231724 1.05
random-access/vortex-tokio-local-disk 764864 772089 0.99
random-access/vortex-tokio-local-disk-footer 1178078 1154460 1.02

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 422375986 432067307 0.98
tpch_q02/datafusion:vortex-file-compressed 110441377 105091795 1.05
tpch_q03/datafusion:vortex-file-compressed 216651778 204780850 1.06
tpch_q04/datafusion:vortex-file-compressed 103498777 100005731 1.03
tpch_q05/datafusion:vortex-file-compressed 364045013 346697098 1.05
tpch_q06/datafusion:vortex-file-compressed 39434500 37718532 1.05
tpch_q07/datafusion:vortex-file-compressed 499523326 474628404 1.05
tpch_q08/datafusion:vortex-file-compressed 373934882 360625787 1.04
tpch_q09/datafusion:vortex-file-compressed 634359336 621316627 1.02
tpch_q10/datafusion:vortex-file-compressed 248000268 244371803 1.01
tpch_q11/datafusion:vortex-file-compressed 84489006 81412739 1.04
tpch_q12/datafusion:vortex-file-compressed 119779180 117628502 1.02
tpch_q13/datafusion:vortex-file-compressed 213161536 210308077 1.01
tpch_q14/datafusion:vortex-file-compressed 50903769 48750105 1.04
tpch_q15/datafusion:vortex-file-compressed 99905603 99600764 1.00
tpch_q16/datafusion:vortex-file-compressed 80588540 77405012 1.04
tpch_q17/datafusion:vortex-file-compressed 630779435 614065700 1.03
tpch_q18/datafusion:vortex-file-compressed 901198634 881566255 1.02
tpch_q19/datafusion:vortex-file-compressed 68077705 64792054 1.05
tpch_q20/datafusion:vortex-file-compressed 167612828 164202400 1.02
tpch_q21/datafusion:vortex-file-compressed 651433450 634135447 1.03
tpch_q22/datafusion:vortex-file-compressed 58733486 58291702 1.01
datafusion / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 480196343 468544097 1.02
tpch_q02/datafusion:vortex-compact 113522479 111727765 1.02
tpch_q03/datafusion:vortex-compact 208559954 203736522 1.02
tpch_q04/datafusion:vortex-compact 115361481 110993955 1.04
tpch_q05/datafusion:vortex-compact 371821209 362864083 1.02
tpch_q06/datafusion:vortex-compact 61831428 60954162 1.01
tpch_q07/datafusion:vortex-compact 504038383 493136927 1.02
tpch_q08/datafusion:vortex-compact 370416130 363896813 1.02
tpch_q09/datafusion:vortex-compact 645484875 627855389 1.03
tpch_q10/datafusion:vortex-compact 254038533 249242561 1.02
tpch_q11/datafusion:vortex-compact 85583038 82100356 1.04
tpch_q12/datafusion:vortex-compact 161163122 157238646 1.02
tpch_q13/datafusion:vortex-compact 260484649 252470424 1.03
tpch_q14/datafusion:vortex-compact 67453182 66686376 1.01
tpch_q15/datafusion:vortex-compact 157120161 158783247 0.99
tpch_q16/datafusion:vortex-compact 86091246 81532277 1.06
tpch_q17/datafusion:vortex-compact 621981850 619503907 1.00
tpch_q18/datafusion:vortex-compact 890544628 876601040 1.02
tpch_q19/datafusion:vortex-compact 211742022 206944445 1.02
tpch_q20/datafusion:vortex-compact 187826456 187603487 1.00
tpch_q21/datafusion:vortex-compact 672599251 656800020 1.02
tpch_q22/datafusion:vortex-compact 66958022 64278687 1.04
datafusion / parquet (1.025x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 507319416 483466125 1.05
tpch_q02/datafusion:parquet 185164615 184549187 1.00
tpch_q03/datafusion:parquet 264812750 269756517 0.98
tpch_q04/datafusion:parquet 128526366 122348973 1.05
tpch_q05/datafusion:parquet 418594893 420460138 1.00
tpch_q06/datafusion:parquet 132321941 134622353 0.98
tpch_q07/datafusion:parquet 607397747 586876794 1.03
tpch_q08/datafusion:parquet 488418604 476397359 1.03
tpch_q09/datafusion:parquet 793274881 763435226 1.04
tpch_q10/datafusion:parquet 619517981 586870726 1.06
tpch_q11/datafusion:parquet 130787778 124797188 1.05
tpch_q12/datafusion:parquet 219635306 220361880 1.00
tpch_q13/datafusion:parquet 365574976 352578078 1.04
tpch_q14/datafusion:parquet 166029751 155194957 1.07
tpch_q15/datafusion:parquet 288824556 270656824 1.07
tpch_q16/datafusion:parquet 131465041 125186481 1.05
tpch_q17/datafusion:parquet 726313255 712180239 1.02
tpch_q18/datafusion:parquet 929301503 924043357 1.01
tpch_q19/datafusion:parquet 288570788 292424390 0.99
tpch_q20/datafusion:parquet 313109177 306808171 1.02
tpch_q21/datafusion:parquet 693432057 675917041 1.03
tpch_q22/datafusion:parquet 216625973 214936113 1.01
datafusion / arrow (1.020x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 744456799 729173527 1.02
tpch_q02/datafusion:arrow 120492240 116886811 1.03
tpch_q03/datafusion:arrow 553165940 540966846 1.02
tpch_q04/datafusion:arrow 405212013 406260447 1.00
tpch_q05/datafusion:arrow 814649222 776745404 1.05
tpch_q06/datafusion:arrow 358342936 343870749 1.04
tpch_q07/datafusion:arrow 1236420275 1212020505 1.02
tpch_q08/datafusion:arrow 1037595984 1016561532 1.02
tpch_q09/datafusion:arrow 1168585420 1153300924 1.01
tpch_q10/datafusion:arrow 699193765 700690529 1.00
tpch_q11/datafusion:arrow 96958912 96549851 1.00
tpch_q12/datafusion:arrow 1215398860 1215006001 1.00
tpch_q13/datafusion:arrow 508926926 477227232 1.07
tpch_q14/datafusion:arrow 405850897 396278636 1.02
tpch_q15/datafusion:arrow 832164209 814496204 1.02
tpch_q16/datafusion:arrow 86263918 84771269 1.02
tpch_q17/datafusion:arrow 1038931721 1047974123 0.99
tpch_q18/datafusion:arrow 2042739296 1990196634 1.03
tpch_q19/datafusion:arrow 592745282 583843754 1.02
tpch_q20/datafusion:arrow 555363041 542826862 1.02
tpch_q21/datafusion:arrow 3296633017 3238218771 1.02
tpch_q22/datafusion:arrow 90530922 87991749 1.03
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 172339601 169830051 1.01
tpch_q02/duckdb:vortex-file-compressed 55060449 55089207 1.00
tpch_q03/duckdb:vortex-file-compressed 134886939 131901855 1.02
tpch_q04/duckdb:vortex-file-compressed 170135310 165344137 1.03
tpch_q05/duckdb:vortex-file-compressed 145977478 142613561 1.02
tpch_q06/duckdb:vortex-file-compressed 37143000 35421474 1.05
tpch_q07/duckdb:vortex-file-compressed 142369352 139819832 1.02
tpch_q08/duckdb:vortex-file-compressed 179039200 178190634 1.00
tpch_q09/duckdb:vortex-file-compressed 412052084 409473671 1.01
tpch_q10/duckdb:vortex-file-compressed 202550429 200443763 1.01
tpch_q11/duckdb:vortex-file-compressed 34078913 32925705 1.04
tpch_q12/duckdb:vortex-file-compressed 111731072 106847099 1.05
tpch_q13/duckdb:vortex-file-compressed 287753471 284949572 1.01
tpch_q14/duckdb:vortex-file-compressed 56751437 55489479 1.02
tpch_q15/duckdb:vortex-file-compressed 93219365 91626111 1.02
tpch_q16/duckdb:vortex-file-compressed 80837340 80104082 1.01
tpch_q17/duckdb:vortex-file-compressed 97501955 96379083 1.01
tpch_q18/duckdb:vortex-file-compressed 307510409 300716969 1.02
tpch_q19/duckdb:vortex-file-compressed 83718341 80522689 1.04
tpch_q20/duckdb:vortex-file-compressed 148633167 148511827 1.00
tpch_q21/duckdb:vortex-file-compressed 532835327 521182399 1.02
tpch_q22/duckdb:vortex-file-compressed 67947823 65230538 1.04
duckdb / vortex-compact (1.025x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 234938212 231089337 1.02
tpch_q02/duckdb:vortex-compact 59736981 58075347 1.03
tpch_q03/duckdb:vortex-compact 142221612 140063647 1.02
tpch_q04/duckdb:vortex-compact 180299194 177292245 1.02
tpch_q05/duckdb:vortex-compact 173307820 169575387 1.02
tpch_q06/duckdb:vortex-compact 57447587 55803274 1.03
tpch_q07/duckdb:vortex-compact 183027686 176273982 1.04
tpch_q08/duckdb:vortex-compact 202011411 193147442 1.05
tpch_q09/duckdb:vortex-compact 445656075 438325710 1.02
tpch_q10/duckdb:vortex-compact 228333628 221980184 1.03
tpch_q11/duckdb:vortex-compact 39158588 38773673 1.01
tpch_q12/duckdb:vortex-compact 166601174 163621662 1.02
tpch_q13/duckdb:vortex-compact 336997407 331332335 1.02
tpch_q14/duckdb:vortex-compact 74601755 73289507 1.02
tpch_q15/duckdb:vortex-compact 118892115 116641084 1.02
tpch_q16/duckdb:vortex-compact 84393776 81032333 1.04
tpch_q17/duckdb:vortex-compact 112961526 109129488 1.04
tpch_q18/duckdb:vortex-compact 299635685 291805914 1.03
tpch_q19/duckdb:vortex-compact 101281839 98535441 1.03
tpch_q20/duckdb:vortex-compact 184298771 181466107 1.02
tpch_q21/duckdb:vortex-compact 555024376 528496517 1.05
tpch_q22/duckdb:vortex-compact 74766563 73052289 1.02
duckdb / parquet (1.020x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262521733 264206015 0.99
tpch_q02/duckdb:parquet 104805551 105130541 1.00
tpch_q03/duckdb:parquet 220667073 214961814 1.03
tpch_q04/duckdb:parquet 141378374 137309811 1.03
tpch_q05/duckdb:parquet 232364219 229473854 1.01
tpch_q06/duckdb:parquet 74669009 75089259 0.99
tpch_q07/duckdb:parquet 192559391 189974216 1.01
tpch_q08/duckdb:parquet 272455034 269859534 1.01
tpch_q09/duckdb:parquet 513611523 507672199 1.01
tpch_q10/duckdb:parquet 636005835 638618888 1.00
tpch_q11/duckdb:parquet 70551375 66219619 1.07
tpch_q12/duckdb:parquet 133316667 131708414 1.01
tpch_q13/duckdb:parquet 🚨 463927936 409671718 1.13
tpch_q14/duckdb:parquet 185220377 182449677 1.02
tpch_q15/duckdb:parquet 105422068 106274214 0.99
tpch_q16/duckdb:parquet 169385132 163496585 1.04
tpch_q17/duckdb:parquet 183475110 181693012 1.01
tpch_q18/duckdb:parquet 373952372 369362899 1.01
tpch_q19/duckdb:parquet 290363388 293908711 0.99
tpch_q20/duckdb:parquet 234886665 223281116 1.05
tpch_q21/duckdb:parquet 592374383 570087123 1.04
tpch_q22/duckdb:parquet 301821931 296068563 1.02
duckdb / duckdb (1.013x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121671772 120989323 1.01
tpch_q02/duckdb:duckdb 50609657 50057189 1.01
tpch_q03/duckdb:duckdb 107563500 105595071 1.02
tpch_q04/duckdb:duckdb 146045624 143255184 1.02
tpch_q05/duckdb:duckdb 124425941 121556803 1.02
tpch_q06/duckdb:duckdb 45430856 44602677 1.02
tpch_q07/duckdb:duckdb 93765051 92296823 1.02
tpch_q08/duckdb:duckdb 123035217 119927995 1.03
tpch_q09/duckdb:duckdb 291487042 284309567 1.03
tpch_q10/duckdb:duckdb 217682550 216829742 1.00
tpch_q11/duckdb:duckdb 20095557 19855445 1.01
tpch_q12/duckdb:duckdb 91917957 91209914 1.01
tpch_q13/duckdb:duckdb 239434466 234102760 1.02
tpch_q14/duckdb:duckdb 80999105 80474512 1.01
tpch_q15/duckdb:duckdb 83910855 83266237 1.01
tpch_q16/duckdb:duckdb 80223780 78561391 1.02
tpch_q17/duckdb:duckdb 89479575 89319002 1.00
tpch_q18/duckdb:duckdb 237640201 236095220 1.01
tpch_q19/duckdb:duckdb 126227386 125857836 1.00
tpch_q20/duckdb:duckdb 119439782 118713379 1.01
tpch_q21/duckdb:duckdb 314635020 310573994 1.01
tpch_q22/duckdb:duckdb 69867750 69649014 1.00
File Size Changes (26 files changed, +0.0% overall, 13↑ 13↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-compact 16.95 MB 17.17 MB +227.59 KB +1.3%
part_0.vortex 10.0 vortex-compact 16.86 MB 16.99 MB +129.06 KB +0.7%
partsupp_1.vortex 10.0 vortex-compact 105.00 MB 105.50 MB +504.77 KB +0.5%
part_1.vortex 10.0 vortex-file-compressed 23.76 MB 23.84 MB +83.41 KB +0.3%
orders_1.vortex 10.0 vortex-file-compressed 133.96 MB 134.21 MB +259.14 KB +0.2%
lineitem_12.vortex 10.0 vortex-file-compressed 129.33 MB 129.55 MB +222.41 KB +0.2%
lineitem_4.vortex 10.0 vortex-file-compressed 129.26 MB 129.45 MB +190.23 KB +0.1%
part_0.vortex 10.0 vortex-file-compressed 23.77 MB 23.79 MB +21.10 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.29 MB 129.39 MB +99.20 KB +0.1%
partsupp_1.vortex 10.0 vortex-file-compressed 119.73 MB 119.78 MB +57.11 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 87.02 MB 87.06 MB +40.38 KB +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.42 MB 129.47 MB +51.11 KB +0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 129.37 MB 129.39 MB +19.86 KB +0.0%
partsupp_0.vortex 10.0 vortex-compact 105.20 MB 105.19 MB 9.84 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 129.32 MB 129.30 MB 15.85 KB -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 129.44 MB 129.42 MB 20.01 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.77 MB 119.76 MB 19.64 KB -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 129.32 MB 129.29 MB 26.90 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.55 MB 129.49 MB 65.30 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 129.55 MB 129.48 MB 70.76 KB -0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 129.24 MB 129.17 MB 72.06 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 129.30 MB 129.21 MB 99.31 KB -0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 129.49 MB 129.25 MB 249.66 KB -0.2%
orders_0.vortex 10.0 vortex-file-compressed 133.33 MB 133.06 MB 284.23 KB -0.2%
supplier_0.vortex 10.0 vortex-file-compressed 5.61 MB 5.59 MB 24.96 KB -0.4%
orders_2.vortex 10.0 vortex-file-compressed 134.83 MB 134.11 MB 736.32 KB -0.5%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Engines: DataFusion No clear signal (-3.6%, environment too noisy confidence) · DuckDB No clear signal (-3.1%, low confidence)
Vortex (geomean): 0.888x ✅
Parquet (geomean): 0.926x ➖
Shifts: Parquet (control) -7.4% · Median polish -8.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.863x ✅, 37↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1582366 1849932 0.86
clickbench_q01/datafusion:vortex-file-compressed 🚀 15988177 19251203 0.83
clickbench_q02/datafusion:vortex-file-compressed 🚀 32445845 36165330 0.90
clickbench_q03/datafusion:vortex-file-compressed 🚀 39002247 47483739 0.82
clickbench_q04/datafusion:vortex-file-compressed 🚀 230162648 270024219 0.85
clickbench_q05/datafusion:vortex-file-compressed 🚀 292030717 338666332 0.86
clickbench_q06/datafusion:vortex-file-compressed 🚀 1641729 2114070 0.78
clickbench_q07/datafusion:vortex-file-compressed 🚀 18293376 21876058 0.84
clickbench_q08/datafusion:vortex-file-compressed 🚀 326852386 372104293 0.88
clickbench_q09/datafusion:vortex-file-compressed 🚀 436789632 510559653 0.86
clickbench_q10/datafusion:vortex-file-compressed 74675750 80881625 0.92
clickbench_q11/datafusion:vortex-file-compressed 🚀 81149581 91718069 0.88
clickbench_q12/datafusion:vortex-file-compressed 🚀 255913745 289958468 0.88
clickbench_q13/datafusion:vortex-file-compressed 🚀 404156097 494691292 0.82
clickbench_q14/datafusion:vortex-file-compressed 252631392 277243150 0.91
clickbench_q15/datafusion:vortex-file-compressed 🚀 274945842 321430844 0.86
clickbench_q16/datafusion:vortex-file-compressed 🚀 639755512 756667354 0.85
clickbench_q17/datafusion:vortex-file-compressed 🚀 629788996 758879057 0.83
clickbench_q18/datafusion:vortex-file-compressed 🚀 1362931355 1538686679 0.89
clickbench_q19/datafusion:vortex-file-compressed 🚀 27831578 35711999 0.78
clickbench_q20/datafusion:vortex-file-compressed 🚀 316162009 351997997 0.90
clickbench_q21/datafusion:vortex-file-compressed 🚀 399029203 455565105 0.88
clickbench_q22/datafusion:vortex-file-compressed 🚀 498522055 570729517 0.87
clickbench_q23/datafusion:vortex-file-compressed 635645983 626455837 1.01
clickbench_q24/datafusion:vortex-file-compressed 🚀 42468624 47704767 0.89
clickbench_q25/datafusion:vortex-file-compressed 🚀 73019912 86048454 0.85
clickbench_q26/datafusion:vortex-file-compressed 🚀 41399096 47919952 0.86
clickbench_q27/datafusion:vortex-file-compressed 421521732 468070492 0.90
clickbench_q28/datafusion:vortex-file-compressed 2358656019 2511010492 0.94
clickbench_q29/datafusion:vortex-file-compressed 🚀 42909524 57021754 0.75
clickbench_q30/datafusion:vortex-file-compressed 🚀 217423060 253145047 0.86
clickbench_q31/datafusion:vortex-file-compressed 🚀 234045381 280036582 0.84
clickbench_q32/datafusion:vortex-file-compressed 🚀 1013704119 1223588080 0.83
clickbench_q33/datafusion:vortex-file-compressed 🚀 1386129645 1586678903 0.87
clickbench_q34/datafusion:vortex-file-compressed 🚀 1390395405 1626988848 0.85
clickbench_q35/datafusion:vortex-file-compressed 🚀 228464524 262703313 0.87
clickbench_q36/datafusion:vortex-file-compressed 🚀 57566340 64631277 0.89
clickbench_q37/datafusion:vortex-file-compressed 🚀 24384261 29683042 0.82
clickbench_q38/datafusion:vortex-file-compressed 🚀 15955386 18025696 0.89
clickbench_q39/datafusion:vortex-file-compressed 120203795 130516545 0.92
clickbench_q40/datafusion:vortex-file-compressed 🚀 11886220 14217817 0.84
clickbench_q41/datafusion:vortex-file-compressed 🚀 12101073 13789132 0.88
clickbench_q42/datafusion:vortex-file-compressed 🚀 11577112 13292812 0.87
datafusion / parquet (0.896x ✅, 27↑ 1↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1535560 1658701 0.93
clickbench_q01/datafusion:parquet 19663943 21292144 0.92
clickbench_q02/datafusion:parquet 42175164 46658472 0.90
clickbench_q03/datafusion:parquet 🚀 34250677 38316476 0.89
clickbench_q04/datafusion:parquet 🚀 258696417 297452823 0.87
clickbench_q05/datafusion:parquet 🚀 320974492 356728244 0.90
clickbench_q06/datafusion:parquet 🚨 1751452 1558493 1.12
clickbench_q07/datafusion:parquet 21306011 22258769 0.96
clickbench_q08/datafusion:parquet 🚀 323375968 380345536 0.85
clickbench_q09/datafusion:parquet 464521341 515071660 0.90
clickbench_q10/datafusion:parquet 🚀 89759666 100708907 0.89
clickbench_q11/datafusion:parquet 🚀 112984058 131905604 0.86
clickbench_q12/datafusion:parquet 🚀 300592229 344434006 0.87
clickbench_q13/datafusion:parquet 🚀 459790144 533304775 0.86
clickbench_q14/datafusion:parquet 🚀 307756794 348391767 0.88
clickbench_q15/datafusion:parquet 🚀 273993716 325218943 0.84
clickbench_q16/datafusion:parquet 664437826 733037663 0.91
clickbench_q17/datafusion:parquet 🚀 628414229 722394566 0.87
clickbench_q18/datafusion:parquet 🚀 1359855587 1615224983 0.84
clickbench_q19/datafusion:parquet 🚀 25994374 30749023 0.85
clickbench_q20/datafusion:parquet 556765254 606602555 0.92
clickbench_q21/datafusion:parquet 🚀 628773304 700387288 0.90
clickbench_q22/datafusion:parquet 907590515 994799378 0.91
clickbench_q23/datafusion:parquet 🚀 4009219273 4587056058 0.87
clickbench_q24/datafusion:parquet 57194194 61146171 0.94
clickbench_q25/datafusion:parquet 125551612 135023196 0.93
clickbench_q26/datafusion:parquet 53676350 57116158 0.94
clickbench_q27/datafusion:parquet 🚀 643958348 726055309 0.89
clickbench_q28/datafusion:parquet 2379572605 2561645426 0.93
clickbench_q29/datafusion:parquet 46767063 45449167 1.03
clickbench_q30/datafusion:parquet 🚀 311101452 350043898 0.89
clickbench_q31/datafusion:parquet 🚀 339865377 378956950 0.90
clickbench_q32/datafusion:parquet 🚀 1050052439 1252410186 0.84
clickbench_q33/datafusion:parquet 🚀 1467440435 1712303625 0.86
clickbench_q34/datafusion:parquet 🚀 1464129817 1693722369 0.86
clickbench_q35/datafusion:parquet 🚀 236612528 275011281 0.86
clickbench_q36/datafusion:parquet 🚀 100831444 115022897 0.88
clickbench_q37/datafusion:parquet 42851965 46427643 0.92
clickbench_q38/datafusion:parquet 61939935 68312833 0.91
clickbench_q39/datafusion:parquet 🚀 200997420 225981518 0.89
clickbench_q40/datafusion:parquet 🚀 22191088 26200872 0.85
clickbench_q41/datafusion:parquet 🚀 21259675 23913163 0.89
clickbench_q42/datafusion:parquet 🚀 21290887 24822212 0.86
duckdb / vortex-file-compressed (0.913x ➖, 17↑ 1↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6235769 7317723 0.85
clickbench_q01/duckdb:vortex-file-compressed 🚀 10280003 11862626 0.87
clickbench_q02/duckdb:vortex-file-compressed 26342689 27672340 0.95
clickbench_q03/duckdb:vortex-file-compressed 🚀 31816853 35396397 0.90
clickbench_q04/duckdb:vortex-file-compressed 184104782 200158820 0.92
clickbench_q05/duckdb:vortex-file-compressed 🚀 174299846 195777837 0.89
clickbench_q06/duckdb:vortex-file-compressed 19556143 21353114 0.92
clickbench_q07/duckdb:vortex-file-compressed 13589407 14923715 0.91
clickbench_q08/duckdb:vortex-file-compressed 264780269 286143265 0.93
clickbench_q09/duckdb:vortex-file-compressed 336547718 367305126 0.92
clickbench_q10/duckdb:vortex-file-compressed 70324257 76285887 0.92
clickbench_q11/duckdb:vortex-file-compressed 81387668 89276735 0.91
clickbench_q12/duckdb:vortex-file-compressed 200171647 222045897 0.90
clickbench_q13/duckdb:vortex-file-compressed 🚀 406828364 460303769 0.88
clickbench_q14/duckdb:vortex-file-compressed 🚀 232113063 260705061 0.89
clickbench_q15/duckdb:vortex-file-compressed 239061730 256218243 0.93
clickbench_q16/duckdb:vortex-file-compressed 526696651 583186696 0.90
clickbench_q17/duckdb:vortex-file-compressed 🚀 424334345 477141436 0.89
clickbench_q18/duckdb:vortex-file-compressed 941174561 1036520492 0.91
clickbench_q19/duckdb:vortex-file-compressed 23643700 26019036 0.91
clickbench_q20/duckdb:vortex-file-compressed 🚀 302532736 358172781 0.84
clickbench_q21/duckdb:vortex-file-compressed 🚀 404958855 461626358 0.88
clickbench_q22/duckdb:vortex-file-compressed 1223456646 1149509141 1.06
clickbench_q23/duckdb:vortex-file-compressed 🚀 176632879 230369630 0.77
clickbench_q24/duckdb:vortex-file-compressed 🚨 44847719 38184815 1.17
clickbench_q25/duckdb:vortex-file-compressed 81980450 80676445 1.02
clickbench_q26/duckdb:vortex-file-compressed 55461171 51166437 1.08
clickbench_q27/duckdb:vortex-file-compressed 428845156 451299723 0.95
clickbench_q28/duckdb:vortex-file-compressed 2992296261 3166726924 0.94
clickbench_q29/duckdb:vortex-file-compressed 29422786 32059003 0.92
clickbench_q30/duckdb:vortex-file-compressed 194180317 208907456 0.93
clickbench_q31/duckdb:vortex-file-compressed 🚀 287515353 320091641 0.90
clickbench_q32/duckdb:vortex-file-compressed 1101582959 1209539718 0.91
clickbench_q33/duckdb:vortex-file-compressed 🚀 1097343169 1253250585 0.88
clickbench_q34/duckdb:vortex-file-compressed 🚀 1175199558 1385473237 0.85
clickbench_q35/duckdb:vortex-file-compressed 376312143 393073346 0.96
clickbench_q36/duckdb:vortex-file-compressed 26244816 29076822 0.90
clickbench_q37/duckdb:vortex-file-compressed 17610456 19498633 0.90
clickbench_q38/duckdb:vortex-file-compressed 🚀 19635154 23996945 0.82
clickbench_q39/duckdb:vortex-file-compressed 🚀 43762122 49237284 0.89
clickbench_q40/duckdb:vortex-file-compressed 17312327 18510050 0.94
clickbench_q41/duckdb:vortex-file-compressed 🚀 17876738 20113057 0.89
clickbench_q42/duckdb:vortex-file-compressed 🚀 17890513 20841615 0.86
duckdb / parquet (0.957x ➖, 1↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22491966 23285434 0.97
clickbench_q01/duckdb:parquet 28840619 29704366 0.97
clickbench_q02/duckdb:parquet 49478767 50705429 0.98
clickbench_q03/duckdb:parquet 40453190 42702986 0.95
clickbench_q04/duckdb:parquet 200795704 215997185 0.93
clickbench_q05/duckdb:parquet 258900253 277620454 0.93
clickbench_q06/duckdb:parquet 46913106 47595556 0.99
clickbench_q07/duckdb:parquet 31686627 31875111 0.99
clickbench_q08/duckdb:parquet 268573886 294664468 0.91
clickbench_q09/duckdb:parquet 397876554 429653655 0.93
clickbench_q10/duckdb:parquet 82515306 86595431 0.95
clickbench_q11/duckdb:parquet 100869540 106050931 0.95
clickbench_q12/duckdb:parquet 282665854 304670982 0.93
clickbench_q13/duckdb:parquet 464773209 505790687 0.92
clickbench_q14/duckdb:parquet 319117001 333429946 0.96
clickbench_q15/duckdb:parquet 250696684 270670259 0.93
clickbench_q16/duckdb:parquet 590426161 639842573 0.92
clickbench_q17/duckdb:parquet 493368164 532676322 0.93
clickbench_q18/duckdb:parquet 1025340929 1127667695 0.91
clickbench_q19/duckdb:parquet 27132314 28368389 0.96
clickbench_q20/duckdb:parquet 419385829 428163371 0.98
clickbench_q21/duckdb:parquet 529103885 561413446 0.94
clickbench_q22/duckdb:parquet 924320355 948848689 0.97
clickbench_q23/duckdb:parquet 267378141 279857825 0.96
clickbench_q24/duckdb:parquet 74585032 74484703 1.00
clickbench_q25/duckdb:parquet 162296516 165818460 0.98
clickbench_q26/duckdb:parquet 52682841 56355067 0.93
clickbench_q27/duckdb:parquet 466267169 483221811 0.96
clickbench_q28/duckdb:parquet 4765542921 4934542974 0.97
clickbench_q29/duckdb:parquet 42167373 44077460 0.96
clickbench_q30/duckdb:parquet 311164660 327301742 0.95
clickbench_q31/duckdb:parquet 377198436 401684506 0.94
clickbench_q32/duckdb:parquet 1096744026 1204630072 0.91
clickbench_q33/duckdb:parquet 🚀 1088386916 1229708793 0.89
clickbench_q34/duckdb:parquet 1144551613 1266402702 0.90
clickbench_q35/duckdb:parquet 372053941 381792671 0.97
clickbench_q36/duckdb:parquet 49241882 48198033 1.02
clickbench_q37/duckdb:parquet 33863934 35065309 0.97
clickbench_q38/duckdb:parquet 36224263 36404604 1.00
clickbench_q39/duckdb:parquet 85006888 78910704 1.08
clickbench_q40/duckdb:parquet 20467022 20441259 1.00
clickbench_q41/duckdb:parquet 20794593 21647443 0.96
clickbench_q42/duckdb:parquet 23118281 22054153 1.05
duckdb / duckdb (0.941x ➖, 2↑ 0↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 16665255 17701342 0.94
clickbench_q01/duckdb:duckdb 34439110 34997807 0.98
clickbench_q02/duckdb:duckdb 50808405 52622701 0.97
clickbench_q03/duckdb:duckdb 54954457 56363281 0.98
clickbench_q04/duckdb:duckdb 210725394 222143173 0.95
clickbench_q05/duckdb:duckdb 280335946 301428021 0.93
clickbench_q06/duckdb:duckdb 32678548 36214376 0.90
clickbench_q07/duckdb:duckdb 34806320 36706741 0.95
clickbench_q08/duckdb:duckdb 276043330 292633343 0.94
clickbench_q09/duckdb:duckdb 387392225 409947936 0.94
clickbench_q10/duckdb:duckdb 115642062 119952696 0.96
clickbench_q11/duckdb:duckdb 125561379 128709540 0.98
clickbench_q12/duckdb:duckdb 256941161 274935201 0.93
clickbench_q13/duckdb:duckdb 438463427 478652932 0.92
clickbench_q14/duckdb:duckdb 281867950 303663894 0.93
clickbench_q15/duckdb:duckdb 237839170 257896565 0.92
clickbench_q16/duckdb:duckdb 555751611 601650205 0.92
clickbench_q17/duckdb:duckdb 464232564 504668355 0.92
clickbench_q18/duckdb:duckdb 🚀 973022908 1143649580 0.85
clickbench_q19/duckdb:duckdb 33805298 36183311 0.93
clickbench_q20/duckdb:duckdb 469528687 480266623 0.98
clickbench_q21/duckdb:duckdb 475219269 491161224 0.97
clickbench_q22/duckdb:duckdb 551343458 571820383 0.96
clickbench_q23/duckdb:duckdb 246503914 270025672 0.91
clickbench_q24/duckdb:duckdb 60378544 63960403 0.94
clickbench_q25/duckdb:duckdb 149159368 156465228 0.95
clickbench_q26/duckdb:duckdb 61536914 64817084 0.95
clickbench_q27/duckdb:duckdb 416526217 430391119 0.97
clickbench_q28/duckdb:duckdb 4379511979 4602550617 0.95
clickbench_q29/duckdb:duckdb 49651809 51670952 0.96
clickbench_q30/duckdb:duckdb 279471854 294885551 0.95
clickbench_q31/duckdb:duckdb 360733809 388415210 0.93
clickbench_q32/duckdb:duckdb 1092547258 1210702042 0.90
clickbench_q33/duckdb:duckdb 1111704148 1223551343 0.91
clickbench_q34/duckdb:duckdb 1188007303 1308360959 0.91
clickbench_q35/duckdb:duckdb 291684208 310850719 0.94
clickbench_q36/duckdb:duckdb 48958614 52020651 0.94
clickbench_q37/duckdb:duckdb 28524493 29407289 0.97
clickbench_q38/duckdb:duckdb 33574179 34732349 0.97
clickbench_q39/duckdb:duckdb 🚀 78648232 87583972 0.90
clickbench_q40/duckdb:duckdb 27070013 28930009 0.94
clickbench_q41/duckdb:duckdb 26744689 27654949 0.97
clickbench_q42/duckdb:duckdb 29200977 29999097 0.97
File Size Changes (104 files changed, -0.0% overall, 57↑ 47↓)
File Scale Format Base HEAD Change %
hits_53.vortex 1.0 vortex-file-compressed 85.76 MB 85.98 MB +227.33 KB +0.3%
hits_62.vortex 1.0 vortex-file-compressed 115.96 MB 116.19 MB +237.33 KB +0.2%
hits_10.vortex 1.0 vortex-file-compressed 69.33 MB 69.46 MB +135.53 KB +0.2%
hits_36.vortex 1.0 vortex-file-compressed 68.35 MB 68.45 MB +111.38 KB +0.2%
hits_7.vortex 1.0 vortex-file-compressed 93.83 MB 93.96 MB +137.55 KB +0.1%
hits_25.vortex 1.0 vortex-file-compressed 112.94 MB 113.09 MB +163.20 KB +0.1%
hits_83.vortex 1.0 vortex-file-compressed 87.32 MB 87.43 MB +111.64 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.62 MB 100.74 MB +123.18 KB +0.1%
hits_26.vortex 1.0 vortex-file-compressed 109.17 MB 109.30 MB +132.01 KB +0.1%
hits_98.vortex 1.0 vortex-file-compressed 117.00 MB 117.14 MB +136.38 KB +0.1%
hits_23.vortex 1.0 vortex-file-compressed 76.20 MB 76.29 MB +88.11 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 76.82 MB 76.91 MB +85.13 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 109.55 MB 109.66 MB +119.40 KB +0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.60 MB 119.72 MB +126.21 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.05 MB 57.11 MB +60.09 KB +0.1%
hits_9.vortex 1.0 vortex-file-compressed 98.94 MB 99.04 MB +103.99 KB +0.1%
hits_80.vortex 1.0 vortex-file-compressed 104.93 MB 105.04 MB +108.86 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.14 MB 111.25 MB +108.84 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.27 MB 108.37 MB +100.00 KB +0.1%
hits_15.vortex 1.0 vortex-file-compressed 87.60 MB 87.67 MB +76.30 KB +0.1%
hits_68.vortex 1.0 vortex-file-compressed 122.97 MB 123.06 MB +92.86 KB +0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.05 MB 99.12 MB +74.33 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.06 MB 69.11 MB +49.00 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 116.86 MB 116.94 MB +79.71 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 167.55 MB 167.66 MB +111.39 KB +0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.92 MB 122.99 MB +75.98 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.30 MB 75.34 MB +42.86 KB +0.1%
hits_2.vortex 1.0 vortex-file-compressed 183.65 MB 183.75 MB +102.27 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 100.80 MB 100.85 MB +56.12 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 86.73 MB 86.77 MB +40.38 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.17 MB 90.20 MB +39.16 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.14 MB 96.17 MB +36.33 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.52 MB 62.54 MB +23.57 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.10 MB 179.16 MB +64.55 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 91.78 MB 91.81 MB +31.80 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 110.84 MB 110.88 MB +35.62 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 75.75 MB 75.78 MB +23.72 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 89.78 MB 89.80 MB +24.85 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.11 MB 123.14 MB +33.97 KB +0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.04 MB 80.06 MB +19.87 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 101.65 MB 101.67 MB +24.55 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.38 MB 119.41 MB +27.02 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.02 MB 69.03 MB +12.41 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.27 MB 93.28 MB +15.84 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 137.01 MB 137.04 MB +22.92 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 222.60 MB 222.64 MB +35.48 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.17 MB 164.19 MB +24.02 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.18 MB 135.19 MB +15.16 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.04 MB 103.05 MB +9.36 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.68 MB 141.69 MB +11.80 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.19 MB 90.19 MB +5.68 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.04 MB +1.65 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.92 MB 168.93 MB +9.16 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 99.12 MB 99.13 MB +4.55 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 185.92 MB 185.92 MB +4.39 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.53 MB 277.53 MB +5.02 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.79 MB 121.79 MB +360 B +0.0%
hits_57.vortex 1.0 vortex-file-compressed 127.84 MB 127.83 MB 9.05 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 83.55 MB 83.54 MB 7.32 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.84 MB 122.83 MB 11.88 KB -0.0%
hits_97.vortex 1.0 vortex-file-compressed 106.78 MB 106.76 MB 12.12 KB -0.0%
hits_67.vortex 1.0 vortex-file-compressed 182.48 MB 182.45 MB 21.55 KB -0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.64 MB 101.63 MB 12.38 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.43 MB 146.41 MB 20.80 KB -0.0%
hits_87.vortex 1.0 vortex-file-compressed 171.26 MB 171.23 MB 31.41 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.42 MB 59.41 MB 11.25 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.07 MB 69.06 MB 15.72 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 226.08 MB 226.03 MB 59.28 KB -0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.35 MB 104.32 MB 29.10 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 182.19 MB 182.12 MB 66.13 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.26 MB 41.24 MB 15.12 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 183.16 MB 183.10 MB 69.98 KB -0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.27 MB 90.23 MB 37.84 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.25 MB 79.22 MB 35.37 KB -0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.40 MB 97.36 MB 45.30 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.13 MB 117.08 MB 54.90 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 79.72 MB 79.68 MB 37.59 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.05 MB 137.98 MB 65.88 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.55 MB 89.51 MB 43.03 KB -0.0%
hits_42.vortex 1.0 vortex-file-compressed 221.86 MB 221.75 MB 108.06 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.31 MB 93.26 MB 49.67 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.41 MB 93.36 MB 53.18 KB -0.1%
hits_69.vortex 1.0 vortex-file-compressed 122.44 MB 122.37 MB 70.45 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 113.84 MB 113.77 MB 69.79 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.61 MB 66.57 MB 41.55 KB -0.1%
hits_54.vortex 1.0 vortex-file-compressed 221.20 MB 221.06 MB 138.93 KB -0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.24 MB 87.19 MB 58.73 KB -0.1%
hits_5.vortex 1.0 vortex-file-compressed 93.00 MB 92.93 MB 64.23 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.57 MB 99.49 MB 74.07 KB -0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.10 MB 99.03 MB 77.55 KB -0.1%
hits_97.vortex 1.0 vortex-compact 69.04 MB 68.98 MB 60.21 KB -0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.48 MB 115.38 MB 102.84 KB -0.1%
hits_31.vortex 1.0 vortex-file-compressed 89.57 MB 89.47 MB 102.15 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 80.39 MB 80.29 MB 100.11 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 143.93 MB 143.74 MB 186.10 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.31 MB 63.22 MB 86.87 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 103.47 MB 103.31 MB 169.30 KB -0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.54 MB 85.39 MB 152.52 KB -0.2%
hits_19.vortex 1.0 vortex-file-compressed 73.29 MB 73.16 MB 131.41 KB -0.2%
hits_91.vortex 1.0 vortex-file-compressed 96.05 MB 95.81 MB 248.35 KB -0.3%
hits_21.vortex 1.0 vortex-compact 51.53 MB 51.39 MB 144.64 KB -0.3%
hits_82.vortex 1.0 vortex-compact 67.00 MB 66.79 MB 219.58 KB -0.3%
hits_90.vortex 1.0 vortex-file-compressed 141.82 MB 139.76 MB 2.06 MB -1.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (-0.0%)
  • vortex-file-compressed: 10.95 GB → 10.95 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.987x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.982x ➖, 1↑ 1↓)
name PR 3ca882a (ns) base 170ff39 (ns) ratio (PR/base)
compress time/Arade 1092073260 1163159576 0.94
compress time/Bimbo 5529957224 5941953084 0.93
compress time/CMSprovider 2704193230 2868461386 0.94
compress time/Euro2016 488410106 491672798 0.99
compress time/Food 364600250 389947104 0.93
compress time/HashTags 867743637 894729941 0.97
compress time/TPC-H l_comment canonical 1220603864 1295147444 0.94
compress time/TPC-H l_comment chunked 1241108964 1269000710 0.98
compress time/taxi 665955854 704369436 0.95
compress time/wide table cols=100 chunks=1 rows=1000 11141849 12349018 0.90
compress time/wide table cols=100 chunks=50 rows=1000 12681753 12213161 1.04
compress time/wide table cols=1000 chunks=1 rows=1000 119100411 129784077 0.92
compress time/wide table cols=1000 chunks=50 rows=1000 125109173 132447894 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 1449716336 1502809128 0.96
compress time/wide table cols=10000 chunks=50 rows=1000 1451144769 1505925987 0.96
decompress time/Arade 28314414 28151535 1.01
decompress time/Bimbo 82856693 89942392 0.92
decompress time/CMSprovider 83103888 81908106 1.01
decompress time/Euro2016 20945640 20345733 1.03
decompress time/Food 8090238 8924143 0.91
decompress time/HashTags 94308791 95454945 0.99
decompress time/TPC-H l_comment canonical 43053877 44880943 0.96
decompress time/TPC-H l_comment chunked 43623631 45315081 0.96
decompress time/taxi 14924899 15929304 0.94
decompress time/wide table cols=100 chunks=1 rows=1000 2354704 2440321 0.96
decompress time/wide table cols=100 chunks=50 rows=1000 2433123 2606677 0.93
decompress time/wide table cols=1000 chunks=1 rows=1000 21806228 22775748 0.96
decompress time/wide table cols=1000 chunks=50 rows=1000 21988246 22200242 0.99
decompress time/wide table cols=10000 chunks=1 rows=1000 243993093 241897324 1.01
decompress time/wide table cols=10000 chunks=50 rows=1000 230303633 243841862 0.94
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2626796019 2709961125 0.97
parquet_rs-zstd compress time/Bimbo 12640115459 12726999149 0.99
parquet_rs-zstd compress time/CMSprovider 6942105229 7113498082 0.98
parquet_rs-zstd compress time/Euro2016 1307612209 1372878371 0.95
parquet_rs-zstd compress time/Food 793268177 811689792 0.98
parquet_rs-zstd compress time/HashTags 2169993142 2341160567 0.93
parquet_rs-zstd compress time/TPC-H l_comment canonical 3213776777 3310792121 0.97
parquet_rs-zstd compress time/TPC-H l_comment chunked 3201425877 3309871970 0.97
parquet_rs-zstd compress time/taxi 1185244452 1251245676 0.95
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6018840 6970976 0.86
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6164915 6711545 0.92
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75108575 79040776 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74816422 77433690 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 787826489 826908400 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 767267606 819432934 0.94
parquet_rs-zstd decompress time/Arade 617682080 644061174 0.96
parquet_rs-zstd decompress time/Bimbo 1699696152 1712885728 0.99
parquet_rs-zstd decompress time/CMSprovider 1697096788 1770766695 0.96
parquet_rs-zstd decompress time/Euro2016 374660562 386797524 0.97
parquet_rs-zstd decompress time/Food 196875170 202965523 0.97
parquet_rs-zstd decompress time/HashTags 650099156 700600285 0.93
parquet_rs-zstd decompress time/TPC-H l_comment canonical 586690193 610097912 0.96
parquet_rs-zstd decompress time/TPC-H l_comment chunked 590843000 613364243 0.96
parquet_rs-zstd decompress time/taxi 244437203 249119535 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2756307 2886796 0.95
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2845182 2888878 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32304637 34132465 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33018423 34706039 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 350110735 357774313 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 346778943 356604948 0.97
vortex-file-compressed size/Arade 145359060 145359060 1.00
vortex-file-compressed size/Bimbo 467259636 467259636 1.00
vortex-file-compressed size/CMSprovider 417784004 417784260 1.00
vortex-file-compressed size/Euro2016 157690100 157039548 1.00
vortex-file-compressed size/Food 41977344 41977344 1.00
vortex-file-compressed size/HashTags 185615716 184161260 1.01
vortex-file-compressed size/TPC-H l_comment canonical 172210864 172216576 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172173216 172015496 1.00
vortex-file-compressed size/taxi 52292908 52292908 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.94
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 2 1 1.13
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.93
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.06
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio decompress time/Food 0 0 0.93
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.06
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.01
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@AdamGS
AdamGS merged commit b2c9e79 into develop Jun 17, 2026
81 of 85 checks passed
@AdamGS
AdamGS deleted the adamg/inline-str-interner branch June 17, 2026 11:35
@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.0%
Engines: DataFusion No clear signal (-12.2%, environment too noisy confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): 0.983x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish -1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.962x ➖, 1↑ 1↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 760933648 801073121 0.95
tpch_q02/datafusion:vortex-file-compressed 890308159 1192905663 0.75
tpch_q03/datafusion:vortex-file-compressed 776128633 988993860 0.78
tpch_q04/datafusion:vortex-file-compressed 470203367 491696999 0.96
tpch_q05/datafusion:vortex-file-compressed 🚨 1190871181 868598893 1.37
tpch_q06/datafusion:vortex-file-compressed 603658154 554695302 1.09
tpch_q07/datafusion:vortex-file-compressed 894516060 868627540 1.03
tpch_q08/datafusion:vortex-file-compressed 1201154580 1459768359 0.82
tpch_q09/datafusion:vortex-file-compressed 1353972059 1361045254 0.99
tpch_q10/datafusion:vortex-file-compressed 1116256035 1056136727 1.06
tpch_q11/datafusion:vortex-file-compressed 620766409 545898600 1.14
tpch_q12/datafusion:vortex-file-compressed 852995427 831128939 1.03
tpch_q13/datafusion:vortex-file-compressed 429117859 417781193 1.03
tpch_q14/datafusion:vortex-file-compressed 540391118 545804691 0.99
tpch_q15/datafusion:vortex-file-compressed 986217249 1278385253 0.77
tpch_q16/datafusion:vortex-file-compressed 🚀 446889095 720719586 0.62
tpch_q17/datafusion:vortex-file-compressed 1255561159 1155822617 1.09
tpch_q18/datafusion:vortex-file-compressed 1350250189 1146051331 1.18
tpch_q19/datafusion:vortex-file-compressed 936616545 900671914 1.04
tpch_q20/datafusion:vortex-file-compressed 907677299 928664410 0.98
tpch_q21/datafusion:vortex-file-compressed 1651728741 1479624481 1.12
tpch_q22/datafusion:vortex-file-compressed 481521470 659309057 0.73
datafusion / vortex-compact (0.934x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 779438614 762992563 1.02
tpch_q02/datafusion:vortex-compact 909384758 902996885 1.01
tpch_q03/datafusion:vortex-compact 717920068 823448942 0.87
tpch_q04/datafusion:vortex-compact 445745949 493844943 0.90
tpch_q05/datafusion:vortex-compact 934273608 1071072370 0.87
tpch_q06/datafusion:vortex-compact 696051693 614783681 1.13
tpch_q07/datafusion:vortex-compact 1198532971 1107299816 1.08
tpch_q08/datafusion:vortex-compact 1350406765 1596716017 0.85
tpch_q09/datafusion:vortex-compact 1308692434 1629384453 0.80
tpch_q10/datafusion:vortex-compact 896530432 1225878243 0.73
tpch_q11/datafusion:vortex-compact 542288858 612795730 0.88
tpch_q12/datafusion:vortex-compact 754190140 803471744 0.94
tpch_q13/datafusion:vortex-compact 431308506 434637847 0.99
tpch_q14/datafusion:vortex-compact 499115325 577606435 0.86
tpch_q15/datafusion:vortex-compact 907901685 928188506 0.98
tpch_q16/datafusion:vortex-compact 376604089 436709687 0.86
tpch_q17/datafusion:vortex-compact 1228292684 1091754036 1.13
tpch_q18/datafusion:vortex-compact 1177553748 1100875503 1.07
tpch_q19/datafusion:vortex-compact 963482643 1126964326 0.85
tpch_q20/datafusion:vortex-compact 902391338 1170606752 0.77
tpch_q21/datafusion:vortex-compact 1541927999 1495017569 1.03
tpch_q22/datafusion:vortex-compact 779333852 733138757 1.06
datafusion / parquet (1.080x ➖, 0↑ 2↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1060492889 897596368 1.18
tpch_q02/datafusion:parquet 🚨 1656179507 766296905 2.16
tpch_q03/datafusion:parquet 1207419418 1052978083 1.15
tpch_q04/datafusion:parquet 527737412 567251597 0.93
tpch_q05/datafusion:parquet 1581573519 1517567968 1.04
tpch_q06/datafusion:parquet 740323111 633250963 1.17
tpch_q07/datafusion:parquet 1736847735 1415527691 1.23
tpch_q08/datafusion:parquet 2001251658 2056451626 0.97
tpch_q09/datafusion:parquet 2011075520 2126709734 0.95
tpch_q10/datafusion:parquet 3453349748 3152590788 1.10
tpch_q11/datafusion:parquet 803261634 874135120 0.92
tpch_q12/datafusion:parquet 859744641 758228533 1.13
tpch_q13/datafusion:parquet 953020312 978805094 0.97
tpch_q14/datafusion:parquet 899071499 962583535 0.93
tpch_q15/datafusion:parquet 1494163975 1307492060 1.14
tpch_q16/datafusion:parquet 598988976 528789516 1.13
tpch_q17/datafusion:parquet 1600780539 1550460332 1.03
tpch_q18/datafusion:parquet 1757258651 1673050813 1.05
tpch_q19/datafusion:parquet 996163026 1206216957 0.83
tpch_q20/datafusion:parquet 1205480896 1379916050 0.87
tpch_q21/datafusion:parquet 1952653215 2042835290 0.96
tpch_q22/datafusion:parquet 🚨 989995483 681210255 1.45
duckdb / vortex-file-compressed (1.064x ➖, 0↑ 2↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 698266436 641947575 1.09
tpch_q02/duckdb:vortex-file-compressed 1160474712 1223994083 0.95
tpch_q03/duckdb:vortex-file-compressed 983002492 839024421 1.17
tpch_q04/duckdb:vortex-file-compressed 740886670 616423676 1.20
tpch_q05/duckdb:vortex-file-compressed 1290256715 1125251289 1.15
tpch_q06/duckdb:vortex-file-compressed 696567766 631819958 1.10
tpch_q07/duckdb:vortex-file-compressed 1310406210 1187101953 1.10
tpch_q08/duckdb:vortex-file-compressed 1457933766 1432499406 1.02
tpch_q09/duckdb:vortex-file-compressed 1751142934 1670777769 1.05
tpch_q10/duckdb:vortex-file-compressed 1402444638 1293497296 1.08
tpch_q11/duckdb:vortex-file-compressed 649473144 616300044 1.05
tpch_q12/duckdb:vortex-file-compressed 🚨 1629397188 1243617413 1.31
tpch_q13/duckdb:vortex-file-compressed 943838898 850932114 1.11
tpch_q14/duckdb:vortex-file-compressed 🚨 902565142 642829404 1.40
tpch_q15/duckdb:vortex-file-compressed 607804298 633777354 0.96
tpch_q16/duckdb:vortex-file-compressed 516427408 493003805 1.05
tpch_q17/duckdb:vortex-file-compressed 1035297898 1119201396 0.93
tpch_q18/duckdb:vortex-file-compressed 840053269 900722655 0.93
tpch_q19/duckdb:vortex-file-compressed 836424784 799003192 1.05
tpch_q20/duckdb:vortex-file-compressed 1363298815 1296751035 1.05
tpch_q21/duckdb:vortex-file-compressed 1921244311 2039967104 0.94
tpch_q22/duckdb:vortex-file-compressed 441742340 513846690 0.86
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 693452376 684193483 1.01
tpch_q02/duckdb:vortex-compact 1089085833 1089819492 1.00
tpch_q03/duckdb:vortex-compact 846196708 946835384 0.89
tpch_q04/duckdb:vortex-compact 574385017 535972590 1.07
tpch_q05/duckdb:vortex-compact 1193032295 1189943776 1.00
tpch_q06/duckdb:vortex-compact 552082235 645432877 0.86
tpch_q07/duckdb:vortex-compact 1170998070 1214599314 0.96
tpch_q08/duckdb:vortex-compact 1506503753 1316114582 1.14
tpch_q09/duckdb:vortex-compact 1592019822 1627750162 0.98
tpch_q10/duckdb:vortex-compact 1140756142 1294019632 0.88
tpch_q11/duckdb:vortex-compact 655249478 744971832 0.88
tpch_q12/duckdb:vortex-compact 1126548617 1019245030 1.11
tpch_q13/duckdb:vortex-compact 901802503 876340027 1.03
tpch_q14/duckdb:vortex-compact 674460871 779006819 0.87
tpch_q15/duckdb:vortex-compact 565700385 589163078 0.96
tpch_q16/duckdb:vortex-compact 451661108 457741613 0.99
tpch_q17/duckdb:vortex-compact 911793188 931871237 0.98
tpch_q18/duckdb:vortex-compact 793536459 901115905 0.88
tpch_q19/duckdb:vortex-compact 814334302 830136530 0.98
tpch_q20/duckdb:vortex-compact 1342591244 1213024582 1.11
tpch_q21/duckdb:vortex-compact 1708226146 1794440615 0.95
tpch_q22/duckdb:vortex-compact 418399914 419576078 1.00
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base 0c1d631 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 935060304 948806653 0.99
tpch_q02/duckdb:parquet 1353286623 1485942133 0.91
tpch_q03/duckdb:parquet 2012344748 1934720235 1.04
tpch_q04/duckdb:parquet 1063406877 1155077104 0.92
tpch_q05/duckdb:parquet 2195350079 2189196838 1.00
tpch_q06/duckdb:parquet 847156996 783963893 1.08
tpch_q07/duckdb:parquet 1938456546 1927470313 1.01
tpch_q08/duckdb:parquet 2612740315 2416871134 1.08
tpch_q09/duckdb:parquet 2631201051 2912673701 0.90
tpch_q10/duckdb:parquet 3229597363 3471213538 0.93
tpch_q11/duckdb:parquet 1094222185 1094313075 1.00
tpch_q12/duckdb:parquet 1326961269 1361126642 0.97
tpch_q13/duckdb:parquet 1632911931 1336891935 1.22
tpch_q14/duckdb:parquet 1557409868 1470263940 1.06
tpch_q15/duckdb:parquet 1254261776 1053580844 1.19
tpch_q16/duckdb:parquet 894857456 990250473 0.90
tpch_q17/duckdb:parquet 1578647221 1405107445 1.12
tpch_q18/duckdb:parquet 1691879925 1509943083 1.12
tpch_q19/duckdb:parquet 1629066611 1679339154 0.97
tpch_q20/duckdb:parquet 2069583767 1983285725 1.04
tpch_q21/duckdb:parquet 1893740187 2278001983 0.83
tpch_q22/duckdb:parquet 1306710775 1232219342 1.06

@github-actions

github-actions Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+2.0%, environment too noisy confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.075x ➖
Parquet (geomean): 1.055x ➖
Shifts: Parquet (control) +5.5% · Median polish +4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.107x ❌, 0↑ 3↓)
name PR 3ca882a (ns) base ddd03a0 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚨 147919439 127783235 1.16
appian_q02/datafusion:vortex-file-compressed 🚨 691395582 588870238 1.17
appian_q03/datafusion:vortex-file-compressed 🚨 379072045 326693871 1.16
appian_q04/datafusion:vortex-file-compressed 48274059924 44615901203 1.08
appian_q05/datafusion:vortex-file-compressed 271775847 251090271 1.08
appian_q06/datafusion:vortex-file-compressed 354591307 330911918 1.07
appian_q07/datafusion:vortex-file-compressed 441943858 409707642 1.08
appian_q08/datafusion:vortex-file-compressed 2025807601 1924561488 1.05
datafusion / parquet (1.085x ➖, 0↑ 5↓)
name PR 3ca882a (ns) base ddd03a0 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 129170321 133835711 0.97
appian_q02/datafusion:parquet 617562892 610236981 1.01
appian_q03/datafusion:parquet 349828459 327984679 1.07
appian_q04/datafusion:parquet 🚨 49223280089 44457886722 1.11
appian_q05/datafusion:parquet 🚨 312397676 281310702 1.11
appian_q06/datafusion:parquet 🚨 406129658 350034627 1.16
appian_q07/datafusion:parquet 🚨 503404830 445224244 1.13
appian_q08/datafusion:parquet 🚨 2212160179 1931634421 1.15
duckdb / vortex-file-compressed (1.044x ➖, 0↑ 1↓)
name PR 3ca882a (ns) base ddd03a0 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 198115552 193664941 1.02
appian_q02/duckdb:vortex-file-compressed 644716447 624267663 1.03
appian_q03/duckdb:vortex-file-compressed 279480549 260136888 1.07
appian_q04/duckdb:vortex-file-compressed 1363862717 1323202487 1.03
appian_q05/duckdb:vortex-file-compressed 🚨 320028956 290398148 1.10
appian_q06/duckdb:vortex-file-compressed 804195083 809229626 0.99
appian_q07/duckdb:vortex-file-compressed 363537605 348074790 1.04
appian_q08/duckdb:vortex-file-compressed 1358839942 1285144836 1.06
duckdb / parquet (1.025x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base ddd03a0 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 212637821 201488180 1.06
appian_q02/duckdb:parquet 615554039 605012262 1.02
appian_q03/duckdb:parquet 294965348 285720397 1.03
appian_q04/duckdb:parquet 1342820889 1330137594 1.01
appian_q05/duckdb:parquet 333101855 317089963 1.05
appian_q06/duckdb:parquet 801704713 796607061 1.01
appian_q07/duckdb:parquet 371012804 364563892 1.02
appian_q08/duckdb:parquet 1283695051 1267808535 1.01
duckdb / duckdb (1.044x ➖, 0↑ 0↓)
name PR 3ca882a (ns) base ddd03a0 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 182079580 172493968 1.06
appian_q02/duckdb:duckdb 571275205 550439468 1.04
appian_q03/duckdb:duckdb 402401296 386034351 1.04
appian_q04/duckdb:duckdb 1340416930 1305653890 1.03
appian_q05/duckdb:duckdb 306858936 280557525 1.09
appian_q06/duckdb:duckdb 790878245 788382544 1.00
appian_q07/duckdb:duckdb 342235746 324261391 1.06
appian_q08/duckdb:duckdb 1268116170 1222452187 1.04
File Size Changes (4 files changed, -0.1% overall, 0↑ 4↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 8 B -0.0%
orderview.vortex 1.0 vortex-file-compressed 76.14 MB 76.12 MB 20.87 KB -0.0%
creditcardview.vortex 1.0 vortex-file-compressed 58.37 MB 58.24 MB 128.57 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 476.54 MB → 476.40 MB (-0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes
@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@AdamGS @robert3005 @joseph-isaacs